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Preface 


Mathematics is like looking at a house from different angles. 
— Thomas Storer 


A conceptually clear induction to fundamental analysis theorems, a tutorial for creative 
approaches for solving problems, a collection of modern challenging problems, a pathway 
to undergraduate research—all these desires gave life to the pages that follow. 

The Mathematical Association of America (MAA) journals have strongly influenced 
teaching and research for over a century. They have been an indispensable source that pro- 
vides new proofs of classical theorems and publishes challenging problems. This is especially 
true for The American Mathematical Monthly, which, according to the records on JSTOR, 
is the most widely read mathematics journal in the world. Since its inception in 1894, the 
Monthly has printed 50 articles on the gamma function or Stirling’s asymptotic formula, 
including the magisterial 1959 paper by Phillip J. Davis, winner of the 1963 Chauvenet 
prize. This is also a place where one finds proofs of “period three implies chaos.” [67] Mean- 
while, its problem section has become the single most challenging and interesting problem 
section, unrivaled since SIAM Review canceled its problem section in 1998. Problems from 
the Monthly regularly lead to further research. For example, the Erdds distance problem 
that served as the genesis of Euclidean Ramsey theory was posed in 1946 and finally solved 
by Guth and Katz in 2010. Recently, Lagarias made a surprising observation: the Riemann 
hypothesis is equivalent to the following elementary statement: 


So d< HAnt+ln(H,)e™, where H, =1+35+---+4, for alln > 1. 
d|n 


A weaker version of this inequality appeared as Monthly Problem 10949. 

Unfortunately, these gems are lost among new papers and new problems, and are rele- 
gated to the background. Consequently, from time to time it is rewarding to revisit these 
marvelous papers and problems. These gems form the foundation of this book. The pur- 
pose of this book is to expose students to these stimulating and enlightening proofs and 
hard problems of classical analysis mainly published in the Monthly. The goal is two-fold. 
First, we present proofs as a form of exploration rather than just a manipulation of sym- 
bols. Knowing something is true is far from understanding why it is true and how it is 
connected to the rest of what we know. The search for a proof is the first step in the 
search for understanding. Drawing on the papers from the MAA journals, numerous proofs 
that are conceptually clear have been chosen. I have reexamined the proofs of these many 
standard theorems with an eye toward understanding them. Each proof provides either a 
novel presentation of a familiar theorem or a lively discussion of a single issue, sometimes 
with multiple derivations of many important theorems. Special attention is paid to informal 
exploration of the essential assumptions, suggestive heuristic considerations, and roots of 
the basic concepts and theorems. Second, we collect problems that will promote creative 
techniques for problem-solving and undergraduate research. Each problem is selected for its 
natural charm—the connection with an authentic mathematical experience, its origination 
from the ingenious work of professionals, develops well-shaped results of broader interest. 


ix 


x Preface 


Involving undergraduates in research has been a long-standing practice in the experi- 
mental sciences; however, it has only recently been that undergraduates have been involved 
in mathematical research in significant numbers. In my experience of supervising student 
research, the selection of appropriate problems and methods for undergraduate research is 
of fundamental importance to success. To achieve the sophisticated blend of knowledge and 
creativity required, students need experience in working with abstract ideas at a nontrivial 
level. However, they receive little training in common math courses, especially in view of 
the “cookbook” experience of many calculus courses. 

Historically, deep and beautiful mathematical ideas have often emerged from simple cases 
of challenging problems. Examining simple cases allows students to experience working with 
abstract ideas at a nontrivial level—something they do little of in standard mathematics 
courses. 

I have used the following three criteria to select the problems: 


1. The statement is fairly short. 


2. The problem is challenging, and not solvable by a straight-forward application of 
standard methods or by a lengthy calculation. 


3. The conclusion is pleasing and its solution requires at least one ingenious idea. 


This book is not merely gathering published theorems and problems together. Indeed, 
each selected proof and problem follows a central theme, contains kernels of sophisticated 
ideas connected to important current research, and opens new perspectives in the under- 
standing of mathematics. It seeks to shed light on the principles underlying these ideas 
and immerse readers in the processes of problem solving and research. It also emphasizes 
historical connections and consolidates results that have been relegated to widely scattered 
books and journals. 

My intention is for this book to be a pathway to advanced problem-solving and under- 
graduate research, offering a systematic illustration of how to organize the natural transition 
from problem-solving to exploring, investigating, and discovering new results. It emphasizes 
the rich and elegant interplay that exists between continuous and discrete mathematics. Ex- 
perimental mathematics is a newly developed approach to discovering mathematical truths 
through the use of computers. This book illustrates how these techniques can be applied 
to help solve problems via Mathematica. I hope this book invites the reader to enjoy the 
beauty of mathematics, to share their discoveries with others, and to become involved in 
the process of constructing new proofs that lead to publications. 

This book is intended for math students who have completed a one-year introductory 
sequence in calculus. In Chapter 1, we give a fairly detailed treatment of the completeness 
theorems. We introduce six theorems that are the fundamental results in analysis and show 
they are, indeed, logically equivalent. Each theorem asserts that R is complete, and together 
enables us to derive many important properties of continuity, differentiability, and integra- 
bility. By applying these theorems in conjunction with the Stolz theorem, we establish the 
convergence of sequences in many different respects. 

Equipped with a working knowledge of sequences, in Chapter 2, we study the conver- 
gence of infinite numerical series. Our focus is on various convergence tests far beyond 
those encountered in a first-year calculus sequence. We provide examples and discuss the 
motivations of the ideas frequently before a new theorem is introduced. We also explore 
the behavior of a convergent series after rearrangements and prove the famous Riemann 
series theorem. The importance of continuity can hardly be overemphasized in the context 
of analysis. Sequential theorems related to continuity and set properties, including the ex- 
treme value theorem, the intermediate value theorem, and the uniform continuity theorem, 
constitute the fundamental core of analysis. 
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In Chapter 3, we give various proofs of three fundamental theorems based on the com- 
pleteness theorems of the real numbers. Surprisingly, we will see that the completeness of the 
real numbers is equivalent to each of these three fundamental theorems. As a consequence of 
the intermediate value theorem, we present Li-York’s beautiful result that “periodic three 
implies chaos.” 

In Chapter 4, we give a rigorous treatment of differentiation and related concepts based 
on limits. First, we focus on two fundamental theorems of derivatives. The first proves that 
a derivative has an intermediate value property. The second gives the mean value theorem 
that plays a central role in analysis. As an application of the mean value theorem, we 
present L’Ho6pital’s rule, which provides us with a powerful tool to compute limits of some 
indeterminate forms. Next, we study some basic properties of convex functions including 
Jensen’s inequality, which provides an effective approach to establish inequalities. Finally, 
we extend the mean value theorem to Taylor’s theorem, which is considered to be the 
pinnacle of the differential calculus. 

Chapter 5 studies the Riemann integral on a bounded closed interval. We assume fa- 
miliarity with this concept from calculus, but try to develop the theory in a more precise 
manner than typical calculus textbooks. We establish the criteria of integrability and the 
sense in which differentiation is the inverse of integration. 

Chapter 6 extends the study of numerical sequences and series to the study of sequences 
and series of functions. Given a sequence or series of functions, it is often important to 
know whether or not certain desirable properties of these functions carry over to the limit 
function. For example, if each function in a sequence or series of functions is continuous or 
differentiable or integrable, can we assume then that the limit function will be continuous 
or differentiable or integrable? In doing so, we introduce uniform convergence and illustrate 
its nature and significance. 

In Chapter 7, with an extra limit process, we develop rules that enable us to integrate 
certain unbounded functions or functions that are defined on an unbounded interval. When 
the integrand involves a parameter, a study of uniform convergence of the integral is needed 
in order to determine whether or not the differentiation and integration on the parameter 
are allowable under the integral sign. We will establish the required theorems in Section 7.2. 
As an application, we introduce the basic theory of the gamma function and its relation to 
the beta function. The gamma function is often the first of the so-called special functions 
that students meet beyond the level of calculus, and frequently appears in formulas of 
analysis. As a showcase, lots of analysis techniques have been invoked during the process in 
establishing various properties of the gamma function. 

As an integral part of this book, the exercises at the end of each chapter provide three lev- 
els of problems (routine, demanding, and challenging) in nature. The challenging problems 
include many Putnam and The American Mathematical Monthly problems. These problems 
do not require more advanced knowledge than what is in this book but often need a bit 
more persistence and some clever ideas. To help the reader with the transition from elemen- 
tary problem-solving to challenging problem-solving, in each chapter, we present various 
examples to give the reader ample opportunity to see where we introduce new ideas and 
how to put them into action. For more help, the reader can refer to [45] and [26]; the former 
is focused on Putnam and the latter is on Monthly. Of course, the fun in such problems is 
doing it yourself rather than in seeing someone else’s solution. 


Acknowledgments. A number of my colleagues have made helpful comments and suggestions 
for turning the manuscript into a book. Among these are Professors Brian Bradie, Neville 
Fogarty, James Kelly, James Martin, and most of all Professor Christopher Kennedy, who 
read through the manuscript and provided much valuable feedback which made this book 
more reader friendly. Thanks also to Robert Ross and the CRC Press’s book publication staff 
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for their expertise in preparing this book for publication. Finally, I wish to thank my wife, 

Ying, and children, Alex and Abby, for their love, patience, support, and encouragement. 
Naturally, all possible errors are my own responsibility. Comments, corrections, and 

suggestions from the reader are always welcome at hchen@cnu.edu. Thank you in advance. 
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Sequences 


Poets write the words you have heard before but in a new sequence. 
— Brian Harris 
The infinite! No other question has ever moved so profoundly the spirit of man. 
— David Hilbert 


In this chapter, we first introduce six fundamental theorems of analysis and show they are 
logically equivalent. Each theorem will assert that the real number system R is complete, and 
together enable us to derive many important properties of continuity, differentiability, and 
integrability. By applying these theorems and the Stolz-Cesaro theorem, we subsequently 
establish the convergence of sequences in many different respects. 


1.1 Completeness Theorems for the Real Number System 


I think it [the calculus] defines more unequivocally than anything else the inception of 
modern mathematics, and the system of mathematical analysis, which is its logical de- 
velopment, still constitutes the greatest technical advance in exact thinking. 

— John von Neumann 


The calculus was one of human most significant scientific achievements. John von Neu- 
mann said: “It is difficult to overestimate its importance.” Although its roots trace back 
into classical Greek times, the significant contributions were made by Newton when devel- 
oping his laws of motion and gravitation, and Leibniz, who created the notation we still 
use today. In the first year calculus course, the techniques of differentiation and integration 
are taught to transform previously intractable physical problems into routine calculation. 
Most often, the principal theorems upon which techniques are based are stated without 
proof, so analysis becomes a course to compensate for the missing proofs. To underpin the 
theory behind the calculus, Cauchy and Weierstruss placed calculus squarely under lim- 
its. Their developments, together with Dedekind and Cantor’s work, revealed that limits 
rested upon properties of the real number system R, foremost among which is what we now 
call completeness. Completeness enriches R with an abundance of properties not shared by 
its subsystem the rational numbers Q. Geometrically, completeness implies that the real 
number line has no holes in it. 

There are two popular ways to construct the real numbers from the rationals: Dedekind 
cuts and Canton’s Cauchy sequences. The constructions offer competing views of what the 
completeness of the real numbers should entail. 

Motivated by the nature of the set {r € Q : r < a} for each a € R, Dedekind introduced 


Definition 1.1 (Dedekind Cut). A Dedekind cut is a subset S of Q such that 
1.5#0,5#Q, 
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2. IfxeS andy <a, theny € S, and 


3. S has no largest rational. 


With this definition, R is the set of all Dedekind cuts. Moreover, every subset S of Q 
that satisfies (1)-(3) has the form {r € Q:: r < a} for some aE R. 


Definition 1.2. Let S be a subset of R. S is bounded above if there is some m € R such 
that x < m whenever x € S. In this case, m is called an upper bound of S. M is a least 
upper bound of S if M is an upper bound for S and M < m for all upper bounds m of S. 
We write M =supS. 


With this definition, we have a = sup{r € Q : r < a}. Consequently, the completeness 
of R is characterized by 


Theorem 1.1 (Least-Upper-Bound Property). Every nonempty subset S of R that is 
bounded above has a least upper bound. In other words, sup S exists and belongs to R. 


By contrast with the Dedekind cut, to fill in the gaps in rationals, Cantor’s construction 
is through approximation. For example, V2 is approximated by the rational sequence 
1 14 141 1414 14142 
* 10’ 100’ 1000’ 10000° ° 


which derived from its decimal expansion. Canton defines each real number as a Cauchy 
sequence like this. Recall that a Cauchy sequence a,, means that if, for every « > 0, there 
exists some N € N such that |a,, — a,| < € whenever m,n > N. Now, R is complete mainly 
due to 


Theorem 1.2 (Cauchy Completeness). Every Cauchy sequence in R converges in R. 
Since every convergent sequence is a Cauchy sequence, Theorem 1.2 is strengthened to 


Theorem 1.3 (Cauchy Criterion). A sequence in R converges in R if and only if it is a 
Cauchy sequence. 


Both constructions provide a foundation for the calculus that did not rely upon geo- 
metric intuition. Each guarantees that when we encounter the least upper bound that a set 
possesses or a number to which a sequence converges, then we can be assured that there is 
indeed a real number there that we can call it as a limit. 

A thorough discussion for constructing the real numbers from the rationals is rather 
long and a bit esoteric for an elementary analysis course. E. Bloch’s recent book [15] offers 
a careful and rigorous description of how R can be logically constructed from Q. Interested 
readers can refer this book for details. 

Rather than constructing the set of R so as to justify its completeness, here we assume 
that R exists, postulate the properties of R that we will need and take them for granted. 
When we prove assertions about real numbers and functions, we will use exactly the prop- 
erties here and not rely on our intuition. 


Definition 1.3. There are two operations called addition + and multiplication -, respec- 
tively, and a relation < on R. For all a,b,c € R, they satisfy the properties: 


Al. a+b=b6+a and a-b=b-a. (Commutative laws) 
A2. (a+b) +c=a+(b+c) and (a: b)-c=a- (b-c). (Associative laws) 


A3. a-(b+c)=a-b+a-c. (Distributive law) 
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A4. There are distinct reals 0 and 1 such that a+0 =a and a-1 =a for all a. (Identity 
laws) 


A5. For each a there exists a real number —a such that a+ (—a) = 0, and if a £ 0, then 
there is a real number 6 such that a-b = 1. (Inverse laws) Here we write b = 1/a. 


A6. For each pair of a and 0, exactly one of the following is true: 


a=b, a<b, or b<a. 


A7. Ifa< band b<c, then a < c. (Transitive law) 
A8. Ifa<b, thena+c<6b+c for any c, anda-c<b-cif0<e. 


Properties A1-A5 are the field axioms while A6-A8 are the order axioms. Thus, the axioms 
A1-A8 assures us that R is an ordered field. Note that Q is also an ordered field. But there 
is no rational number in Q whose square is 2. So \/2 is missing from Q, which is what we 
mean by a “hole.” Consider 


S ={x|ax € Q and 2? < 2}. 


This set is bounded above. We can use sup S to get at the missing /2 if sup S' exists. Since 
this kind of nature is indispensable to the limits, we need one more axiom for the real 
numbers. 


Definition 1.4 (Completeness Axiom). Every nonempty subset of R that is bounded 
above has a least upper bound. 


We now have asserted as axiomatic that R contains all rational numbers and is complete. 
It is interesting to see that rather than identify the limit explicitly, completeness provides the 
assurance that a number is out there somewhere. In mathematics, such results are commonly 
called existence theorems. The existence is often sufficient for theoretical purposes. 

The next two existence theorems provide some nice applications of what we can do with 
completeness. 


Theorem 1.4 (Archimedean Property). If x,y > 0, then there is a positive integer n 
such that nx > y. 


Proof. We proceed by contradiction. Let 
S = {a|a=nz, nis a positive integer}. 


If the statement is false, then y would be an upper bound of $. By the completeness axiom, 
let M = sup S. Then na < M for all positive integers n. In particular, (n + 1)a < M and 
therefore 

na<M-—<2z 


for all positive integers n. This implies that M — x is an upper bound, which contradicts 
the definition of M. 


Consequently, this theorem yields two facts we will use often: 
1. Given a real number zx, no matter how large, there exists an integer n such that 
n> x. 


2. Given a real number x, no matter how small, there exists an integer n such that 
1 
—~ <2. 
n 


4 Sequences 


Theorem 1.5 (Density of Q). Ifx,y € R with x < y, then there exists some r € Q such 
thatzr<r<y. 


Proof. Since x < y, we have y — x > 0. By the Archimedean property, there is a positive 
integer q such that q(y — x) > 1. Moreover, there is an integer n such that n > qx. Indeed, 
this statement is obvious when x < 0, and it follows from the Archimedean property again 
if c > 0. Let p be the smallest integer such that p > qx. Then p—1 < qz, and so 


qx <p<1lt+q@ < qy. 


Since q > 0, it follows that 
a< z <y. 
q 


This proves the theorem with r = p/q. 


A real number that is not a rational number is called an irrational number. This theorem, 
together with the irrationality of 2, enables us to show that the irrational numbers are 
also dense in the reals. In fact, if z,y € R with x < y, there are rational numbers r; and rg 
such that 

LM] <7. < y. 
Let 


1 
BST py ae tl) 


Then z is irrational and 7 < z < y. 

The completeness axiom can be put into several equivalent forms. Indeed, there are 
other versions of completeness of R cast in terms of monotone sequences, nested intervals 
and subsequences. Once the real number system is established, the following three theorems, 
together with the Heine-Borel theorem that we will introduce later, are logically equivalent 
to the completeness axiom. Each may thereby serve as a way of defining completeness of 
R. It might be difficult at this point for us to see the extreme importance of these results, 
but as we penetrate the subject more deeply, we will become more and more aware of their 
basic characteristics. 

Notice that there are bounded sequences which diverge. But, with an additional hypoth- 
esis, the following principle enables us to conclude convergence. 


Theorem 1.6 (Monotone Convergence Theorem). Let a, be a sequence that is mono- 
tone increasing and bounded above. Then ay, converges. 


The next theorem is possibly the best mathematical statement equivalent to the statement 
that R has no holes. 


Theorem 1.7 (Nested Interval Theorem). Let I, = [an,bn] be closed intervals such 
that 


1. Ing41 C In for everyn EN, and 
2. limn-yoo (bn — Gn) = 0. 
Then there is a unique real number that belongs to every I. 


The third result is one of the most notable theorems in analysis. It asserts that the sequence 
may diverge with boundedness alone, but some part of it must converge. 


Theorem 1.8 (Bolzano-Weierstrass Theorem). Every bounded sequence has a conver- 
gent subsequence. 
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We prove the equivalence of these theorems in a simple loop: 


Cys (ey aay) Ss (is) SS Gs) Sa), 


A clever and surprising approach used in a proof is often called a “trick.” But a trick used 
for a second time becomes a technique. The loop proofs will demonstrate typical techniques 
that are frequently encountered in analysis. For pedagogical purposes, this will give the 
reader a foretaste of a refreshing phenomenon that they will meet over and over again as 
they continue their analysis journey: to a much greater extent than is commonly recognized, 
completeness turns out to be equivalent to many other theorems in analysis. For example, 
the extreme value theorem, the mean value theorem, and the Darboux integral theorem are 
all completeness properties. The process of developing this observation will be reexamined 
in later chapters. 

We now turn to the proof of the list of implications and demonstrate how each theorem 
asserts the completeness of R in its own particular language. 


Proof of (1.1) => (1.6). Let (an) be a sequence that is monotone increasing and bounded 
above. To prove that a, converges by the definition, we need a candidate for the limit. For 
this purpose, we define S = {a, : n € N}. Since S is bounded above, Theorem 1.1 implies 
that S has a least upper bound, so a = sup S$ provides us with the expected candidate. We 
only need to prove that a, converges to a. For any € > 0, a — € is not an upper bound for 
S, so there exists some N € N such that 


a-—€<ayn <a. 
Since a, is monotone increasing for any n > N, we have 
a-e€<an <Gn Sa<a+te, 


and so 
lan —a|<e whenever n> N. 


This proves that a, converges to a. 


Remark. Here the limit of a bounded increasing sequence is indeed the least upper bound. 
A similar result holds for a monotone decreasing sequence. 

In analysis, Cantor’s nested interval theorem plays a central role. It can be viewed as a 
geometric consequence of the monotone convergence theorem. 


Proof of (1.6) => (1.7). The assumption I,41 C I, implies that, for every n € N, 
ay St) San SL An41 < basi < bn <--> Sy. 


In particular, a, is monotone increasing and bounded above by 6;, and b,, is monotone 
decreasing and bounded below by a;. Thus, by the monotone convergence theorem and the 
remark above, both a, and b, converge. Let 

lm a, =a, lim b, =0b. 

noo noo 


Then 
Qn <a<b<bn, foralln EN. 


The assumption (2) yields that a = b, and so a is the only real number common to every 
pe 
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Remark. The nested interval theorem does not tell us what the common point is, but it does 
say that as n gets larger, both a, and b, are approaching a definite fixed number mono- 
tonically. In particular, it implies that there exists a unique common point to every nested 
rational intervals whose lengths shrink to zero. This can be interpreted as a confirmation 
that there are no holes in the real number system. 

Given a sequence a, let nz, € N satisfy 


ny<ng< ng <se-. 


Then by = an, (kK = 1,2,....) is called a subsequence of a,. It is often important to study 
various subsequences of a given sequence in order to learn more about the behavior of the 
sequence itself. The notion of finding a convergent subsequence from a given sequence oc- 
curs frequently in analysis. The Bolzano-Weierstrass theorem is basic in that it establishes 
the existence of such a convergent subsequence under very simple conditions on the given 
sequence. To prove the Bolzano-Weierstrass theorem, we use the idea that if some subse- 
quence ad», converges to a, then there must be infinitely many terms of ay, (hence a,,) that 
are arbitrarily close to a. Thus, we need to show the existence such an a with infinitely 
many a, arbitrarily close. This is can be done via a trick bisection method along with the 
nested interval theorem. 


Proof of (1.7) => (1.8). Let cp, be bounded below by a and above by b. Then c, € I := 
[a, b] for all n € N. Divide I into two equal subintervals by the midpoint (a+ b)/2. Then at 
least one of these two intervals must contain infinitely many of the c,. Denote this interval 
by I, = {x : ay < & < by}. Next divide I; into two equal subintervals by its midpoint; 
again at least one of these subintervals must contain infinitely many of the c,,. Denote this 
interval by Ip = {x : ag < x < bg}. Repeat the process in this manner to obtain a sequence 
of closed intervals that satisfy 


1. I, DIgD 13 D--- and each J, contains c, for infinitely many of k; 
2. The length of I, is (b — a)/2", which goes to 0 as n > oo. 


By the nested interval theorem, there is exactly one point c common to all those intervals. 
It seems reasonable to claim that c is the candidate we were looking for. 

We now construct a subsequence of c,, which converges to c. Choose c,, from [;. Next 
choose Cp, € [2 with ng > n1. We can do this because J, has infinitely many of c,. Contin- 
uing this process by induction yields the subsequence c,,,. By the approach of selection we 
have 

dig SG Sb eS Ly Dye ee 


Since both a, and b, converge to c as k — ov, it follows that c,, converges to c as 
k-> ow. 


Remark. In the proof, the “bisection method” trick, which has become a popular technique, 
is often used to setup a collection of bounded and nested closed intervals. We begin with an 
interval [a1, 61], which is then divided in half at its midpoint (a; + b,)/2. We next choose 
one of the resulting intervals called [a2, bz]. We continue to choose subintervals and halve 
them. Here, how to pick up [a,, b;] and then how to choose between the two subintervals at 
each step depends on what we are trying to prove. We want the chosen intervals to exhibit 
a certain nature, and during the bisection we must ensure that this nature is inherited by 
each subsequent interval, i.e., [a1, bi] to [a2, bz], [a2, b2] to [a3, b3], and so on. This forces the 
nature to be passed onto a neighborhood of N72, I,. For the proof above, we always choose 
the nature that [a,, b,] contains infinitely many terms of the sequence. This process is very 
similar to the binary search algorithm in computer science. 
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The convergent subsequence in the Bolzano-Weierstrass theorem may or may not be 
monotone. But, via the following peak index argument, due to Newman [72], we can assert 
every sequence indeed has a monotone subsequence. In particular, the sequence sinn has a 
monotone subsequence. This is quite surprising and not obvious at all! 


Theorem 1.8* (Stronger Bolzano-Weierstrass Theorem). Every sequence an, has a 
monotone subsequence. Thus, every bounded sequence has a monotone convergent subse- 
quence. 


Proof. We begin by defining the peak index. An index m is called a peak index if 
Qn <Qm for alln > m. 
There are two distinct cases: 


Case 1. There are only finitely many peak indices. Then we can choose an index N such 
that there are no peak indices greater than N. Define ny = N +1. Since nj is not a peak 
index, there is an index ng > m1 such that a,, > an,. Recursively, we can define a strictly 
increasing subsequence ay. (To see this selection process more clearly, display ay, on the 
number line.) 


Case 2. There are infinitely many peak indices. For each natural number k, let nz be the 
k-th peak index. The definition of the peak index implies that an,,, < @n, for all k. Thus 
the sequence a@,, is decreasing. 


We return to prove the Cauchy criterion based on the Bolzano-Weierstrass theorem. 


Proof of (1.8) => (1.8). We first show that a convergent sequence is necessarily Cauchy. 
Suppose limy5oo @, = A. Then given any € > 0 there is some N € N such that 
€ 


5 whenever n > N. 


la, — A| < 
Therefore, if m,n > N, we have 


lam — dn] < lm — Al +|A—an] <5 +5 =6 
and so ay, is a Cauchy sequence. 

Sufficiency is harder. We need to show that there is a number A to which the sequence 
converges. Our immediate goal is to use the Bolzano-Weierstrass theorem to find such an 
A. Suppose that a, is a Cauchy sequence. First, we claim that a, is bounded. Letting e = 1 
yields that there is a N € N such that 


|@m —Qn| <1 whenever m,n > N. 
Choosing mg > N, for any n > N, we find that 
lan| = |@n — Amy + Amo| < |@n — @mo| + |@mo| < 1+ |amo|- 
Let 
M = max{|a;|, |a2|,--+ ,|an|,1+ |an,|}- 


Clearly, |a,| << M for all n € N and so a, is bounded. 

Next, by the Bolzano-Weierstrass theorem, the sequence a, has a convergent subse- 
quence, say a,,, which converges to A. We show that indeed a,, itself converges to A. To 
this end, for any € > 0, there exists N, € N such that 


lam — Gy| < whenever m,n > Nj. 


Dla 
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Choose nz € N large enough that 
€ 
lan, — Al < 5 whenever nz, > Nj. 


Thus, 


lan — A] < |@n — An,| + lan, — Al < ; + ; =e  whenevern > Mi, 


and so the sequence a, converges to A. 


Finally, to close the loop, we prove the Cauchy criterion implies the least-upper-bound 
property. 


Proof of (1.3) => (1.1). Let S be bounded above and suppose that b is an upper bound 
of S. We prove that S has a least upper bound by the bisection method. The proof will 
consist of three components: 

1. Constructing [a,,,b,] such that b, is an upper bound of S and a, is not. 

2. Showing the sequence (b,,) is a Cauchy sequence and converges to a limit M. 

3. Showing the M is the least upper bound of S. 


Choose any number in S$ and denote it by a. Let b} = b and define I, = [ay, bi]. 
Construct nested intervals as follows. 
Consider the midpoint (a; + b,)/2 of Ii: 
(a) 
(b) 


(a1 +b1)/2 is an upper bound of S, we define Iz = [a2, b2] = [a1, (a1 +b1)/2]. 
(a, + b1)/2 is not an upper bound of S, then there exists s € S such that 
s> (ay + by) /2. We define Ig = [a2, b9] = [(a1 + by) /2, by]. 


In both cases, we have that bz is an upper bound of S and Iz S #4 @. Repeat the process 
in this manner to obtain a sequence of closed intervals that satisfy 


If 
If 


Gi) Dig DIg3Dd--:; 
(ii) bn — Gn = (b1 — a) /2"7}; 
(iii) For every n € N, b, is an upper bound of S and I, S 4 0. 
Thus, for m,n € N,m > n, by (i) and (ii) we have 


1 
|Drn = br | = bn — bm < bn — Gn = gn-1 (by a1), 


and so b,, is a Cauchy sequence. This implies that b,, converges from the Cauchy criterion. 

Let limp+oo bn = M. We show that M = supS. Indeed, for every s € S and every 
n €N, we have s < b, and so s < M, which means that M is an upper bound of S$. On 
the other hand, for any € > 0, since b, — an — 0 as n + oc, there is no € N such that 
dno — Ong < €. Since b,, > M, 


Any > bn, —€ => M —e. 


By (iii) SA In, 4 0, we deduce that M—e is not an upper bound of S and so M = sup S. 


Can you figure out where we have used the Archimedean property of R in the above 
proof? This implies that Cauchy completeness, together with the the Archimedean property, 
is equivalent to the completeness axiom. 

We now illustrate some applications of these theorems with two examples. 
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Example 1.1. The Fibonacci numbers F,, are defined by Fi = Fy = 1 and Fy42 = Fn + 
F,-1 for alln € N. Show that 
li Fn4i 
im 


=9, 
noo n 
where 6 = 14V5 | which is called the golden ratio. 
Proof. Observer the first ten terms of the ratio ry := Fr4i/Fn: 
13° 21 34 55 89 
ie 3.5 8 13 3 


7" 2? 37 57 8? 13? 21’ 34’ 55° 
In round off decimal form, we have 


1.0000, 2.0000, 1.5000, 1.6667, 1.6000, 1.6250, 1.6154, 1.6190, 1.6176, 1.6182. 


This suggests that, although r,, itself is not monotone, the subsequence rzn_1 is monotone 
increasing and bounded above, and rz, is monotone decreasing and bounded below. To 
confirm the above assertions, we first prove that 1 < r, < 2 for every n € N. We have 
r, = 1. Suppose that 1 < rz, < 2. Since 


rp ee ee ee 
1 — - ’ 
"i Beet Fry Tk 


we have ; i i 
1<14-<14—=7rg41<14+5=2. 
2 Vk 1 


By induction, this proves that 1 <r, < 2 for every n € N. Next, for n > 3, we have 


rn = 14 : —14 : ic Pe, 
Tn-1 1+ 1/Tr—2 1+ Tn—2 
Hence 
Tn Tn—2 Tn — Tn-2 


Tnt+2 Tr 


= l+r, 1l+rp_e2 = (1+rn)1+rn—2) 


This implies that r,42—Tr,y has the same sign as ry —Tn_2. Since r3 —T, = 3/2—1 = 1/2 >0 
and r4 — rg = 5/3 — 2 = —1/3 < 0, using induction again yields 


Yan-1—Y2n-3 > 9, = Tan — Tan-2 < 0. 


This shows that ro,_1 is monotone increasing and rg, is monotone decreasing. By the 
monotone convergence theorem, rzn—1 and rz, both converge. Let 


Ty = lim T2n-1 and LI» = lim T2n- 
n—+oco n+ oo 


Then 


: ; Tan—3 Ly 
I, = 1 p= Syl 1+ ——— ]=1 ; 
: Rares Fan) Pai ( q 1+ 1) me 1+, 


Ton-2_) _, , te 
1+Ten—2 © 1+ LD" 


Ly = lim re, = lim (: | 
noo n> oCo 


Thus L, and Ly» both satisfy the equation x? —x—1 = 0. Consequently, solving the quadratic 
equation yields 
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Moreover, for any € > 0, there are N, and N2 such that 
lron-1 - | <€ whenever n > Nj; 


lron — | <e€ whenever n > No. 


Let N = max{2N1,2No}. Then 
lr, —¢|<e€  whenevern> WN. 


This proves 


as desired. 


This example indicates that once we know that the limit exists, we can assign it a symbol 
and find an equation for it. Without knowing the limit exists, such a procedure may lead to 
a spurious solution. For example, consider the sequence defined by 71 = 1,%n41 = 2x? for 
n EN. Clearly, x, diverges. But if you let | = lim, ,.. %n, then take limit on z,41, = 22? 
resulting | = 217. Here J must be either 0 or 1/2. 

Recall that an enumeration of a set S is a bijection which maps the elements of S' into 
a sequence without repetitions: 

X1,X2,U3,-.-- 


If there exists such an enumeration of S, S' is called countable. Otherwise, S is uncountable. 
Example 1.2. Show that R is uncountable. 


The most famous proof of the uncountability of R probably is Cantor’s “diagonalization 
argument.” His approach is clever and historically important. We can’t help presenting it 
below. But his proof used the fact that every real number can be represented in decimal 
notation. As an application of the nested interval theorem, we present a self-contained proof. 


Cantor’s proof. Notice that tan(2x% — 1)7/2 is a bijection between (0,1) and R. So it suf- 
fices to show that (0,1) is uncountable. Cantor did the proof by contradiction. Suppose 
{x1,£2,%3,...} is an enumeration of the numbers in (0,1). Represent each x, as a decimal 
expansion: 


1 = 0.041412013014015°°° , 
Lq = 0.a21422023024095 °°: , 


X3 = 0.031432033034035°°° , 


In = 0.4n1An20n34n44n5 Perey 


where each a;; is a digit among {0, 1, 2,--- , 9} and repeating 9s are chosen as the terminating 
decimal expansions. For example, use 0.5 instead of 0.49999.... Let 


t= 0.611 b22b33b44b55 ceca | 


where bpn # Gnn for all n € N. Since x is different from x, in the nth decimal place, x is 
not in the above enumeration list. Thus, there is no one-to-one correspondence between N 
and (0,1). This proves that (0,1) is uncountable. 


Completeness Theorems for the Real Number System 11 


Proof by the nested interval theorem. We proceed by contradiction as well. Suppose R is 
countable. Then there is a bijection between R and N. Let 


R= {x1,@2,-°° ,Un, tf. 
We construct the nested intervals as follows: 


1. Let = (a1, 64] such that I, C R \ {xy}. 


2. Divide J; into two disjoint closed intervals. One of those will not contain x9; 
let that interval be Jo. 


3. Once I,_1 is well-defined, choose I, such that I, C In_1 \ {an}. 
It then follows from the nested interval theorem that there is a y € I, for all n € N. On the 


other hand, since x, ¢ I, for all n € N, it implies that y # x, for all n € N, so the above 
enumeration is not one-to-one. The contradiction shows that R is uncountable. 


We conclude this section with one more completeness theorem of the real numbers. This 
theorem plays an important role not only in the study of analysis (for example, uniform 
continuity and the Riemann integral), but also in the study of many different areas of 
mathematics such as Topology. 

We first extend our discussion from a sequence to an arbitrary set S of real numbers. 
The Bolzano- Weierstrass theorem guarantees that every bounded sequence has a convergent 
subsequence. As an analogy, we define 


Definition 1.5. A point xo is called a limit point (or an accumulation point) of the set S 
if for any given € > 0, there is a point x € S,x #29 such that |x — xo| <e. 


The limit point x9 may lie in S or not. For example, if S = (a,b), then the points a and 
b and all real numbers between a and 0 inclusive are limit points of S. But, neither a nor b 
belongs to S. 

Analogous to the Bolzano-Weierstrass theorem for sequences, we have 


Theorem 1.9 (Bolzano-Weierstrass Theorem for Sets). Every bounded infinite set 
has at least one limit point. 


Proof. Let S be a bounded infinite set. Then we can select a sequence a, of distinct 
numbers from S. Clearly, this sequence is bounded. By the Bolzano-Weierstrass theorem, 
Gy has a convergent subsequence, which we call ap,. 
Let xo = limp—yoo Gn,. We claim that xo is a limit point of S. Let € > 0. Then there is 
Kk EN such that 
ln, —2o|<e€ whenever k > K. 


In addition, we can require that a, 4 xo since a,,, and hence a,,, is a sequence of distinct 
numbers. Thus, for any e > 0, there are a,, € S and a,, # %p such that 


|Gn, —%o|<e€ wheneverk > K. 


This proves zo is a limit point of S by Definition 1.5. 


Let 
U.(%o0) = (0 — €, 20 + €). 


U.(ao) is called an €-neighborhood of the point 2. We next define 


Definition 1.6. A set S C R is called open if for every x € S there is an € > 0 such that 
U.(a) CS. A set S CR is called closed if its complement S° := R\ S is open. 
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By this definition, both R and (a,b) are open sets. Since (—co,a) U (b,0o) is open, 
it follows that [a,6] is closed. The following theorem indicates that a closed set can be 
characterized by the limit points of the set itself. 


Theorem 1.10. A set SC R is closed if and only if S contains all its limit points. 


Proof. Suppose S is closed. Let 2 € S°. It suffices to show that xp is not a limit point 
of S. Since S© is open, there is an € > 0 such that U.(xo) C S°. Thus there is no « € S 
satisfying |x — xo| < €, and so 2p is not a limit point of S. 

On the other hand, let S be a set which contains all its limit points. For every point 
x € S®, since x is not a limit point of S, there must exist an e > 0 for which no number 
y € S satisfies | — y| < «. Thus, U-(a) C S°, which implies that S° is open, so that S itself 
is closed. 


Definition 1.7. A set S C R is called sequentially compact if every sequence an € S has a 
subsequence that converges to a number in S. 


By this definition, S, = [0,0o) is not sequentially compact. Indeed, let a, = n for n € N. 
Every subsequence of a, is unbounded and so divergent. The set Sz = (0, 1] likewise fails 
to be sequentially compact since the sequence a, = 1/n € S2 converges to 0, but 0 ¢ So. 
However, we have the following test. 


Theorem 1.11. Jf S CR is closed and bounded, then S is sequentially compact. 


Proof. Let a, be a sequence in S. The boundedness of S implies that a, is bounded. By 
the Bolzano-Weierstrass theorem, a, has a subsequence ay, that converges to a. Since S' is 
closed, it follows that a € S, and so S' is sequentially compact. 


In particular, the closed interval [a, b] is sequentially compact. Finally, we define 


Definition 1.8. A collection of open sets G = {U;} is called an open covering of the set S 


if 
Se |) Oy 
UiEG 


An open covering G is finite if |G| < co. 


Example 1.3. Let S; = (0,1). Define G = {U; = (1/2',3/2*)}. Clearly, $1 C U%, Ui. 
Notice that, no matter what index N is selected, there is a positive number less than 1/2" 
which does not belong to UN, U;. Therefore, there is no finite sub-collection of G that also 
covers S$}. 


The following theorem asserts the existence of a finite sub-covering for closed intervals. 


Theorem 1.12 (Heine-Borel Theorem). Jf G = {Ui} is an open covering of [a, b], then 
there is a finite sub-covering of G that also covers [a,b]. 


Proof. We proceed by contradiction. Assume that no finite subset of G covers [a,b]. We 
divide [a, b] into two equal subintervals at the midpoint (a+b)/2. Then at least one of these 
two intervals cannot be covered by a finite subset of G. Otherwise, if G; C G is a finite 
subcovering of [a, (a+ b)/2] and Gz C G is a finite subcovering of [(a + b) /2, b], then G; UG 
is a finite subcovering of [a, 6], contrary to the assumption. Let I; = [a1,b1] C [a,b] be an 
interval that has no finite subcovering. Next we split J; into two equal subintervals at its 
midpoint; again at least one of these subintervals cannot be covered by a finite subset of G. 
Denote such an interval by Iz = [a2, be]. Repeating this process, we obtain a sequence of of 
closed intervals that satisfy 
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2. The length of J, is (b — a)/2"~+, which goes to 0 as n — oo; and 
3. Each J, cannot be covered by a finite subset of G. 
By the nested interval theorem, there is a unique point 29 € [a,b] common to each [,,. 
Because G is a covering of [a,b], there is a open interval U; C G such that a2 € U;. By 


(2), taking N large enough, we have 
In C Uj. 


This means that U; covers Iy, which contradicts (3), and this establishes the theorem. 


Definition 1.9. A set S C R is called compact if every open covering of S contains a finite 
sub-covering that also covers S. 


In this terminology, the Heine-Borel theorem says that [a,b] is compact. This property 
will play an important role in the study of uniform continuity and the Riemann integral. 

As an application, we can reprove the previous five completeness theorems by using the 
Heine-Borel theorem solely. Here we content ourselves with proving just the nested interval 
theorem. 


Proof. By contradiction, we first prove that 


() [an bn] #0. 


To this end, assume that 


For every n €N, let 


Taking complements 


8 


(a1, bi] \ Ghee = ([an, b n| \ Un) iat Gn, b | 


it then follows that US, Un D [a1, bi]. By the Heine-Borel theorem, a finite subset {U,,, }t_, 
covers [a1, 0;], i.e 


M 
by Onis ag [a1, 03]. 
k=1 


This implies that [a1, by] \ U2, Un, =, and so NM, [a@n,,bn,] = 0. But, this contradicts 
the assumption 
M 


() [Onis Ona) = [Gna Ona]: 
k=1 


This proves ()~—, [a@n,6n] # @. Next, we show the uniqueness. Assume that z,y € 
N24 [an, bn]. Then x,y € [an, b»] for every n € N, and so 


|a — y| < |bn — an| 9 0 as n > co. 


Hence x = y and so N°, [an, b,] contains a unique point. 
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We now have established the equivalence between the nested interval theorem and the 
Heine-Borel theorem. Notice that the Heine-Borel theorem actually is a contrapositive-type 
statement of the nested interval theorem. The nested interval theorem converts an interval 
property into a point property by constructing suitable nested intervals to single out the 
required point, while the Heine-Borel theorem extends a local property at points to the 
entire interval by extracting a finite set from an infinite set. Together these two theorems 
enable us to interchange arguments between intervals and specific points. The next two 
examples illustrate this idea. 


Example 1.4. If f(x) is unbounded on [a,b], prove that there exists a point xo € [a,b] such 
that for any 6 > 0, f(a) is unbounded on (xo — 6,%9 + 6) A [a, BI. 

Proof. By assumption, f(x) is unbounded either on [a, (a + b)/2] or on [(a + 6) /2, b]. Let 
I, = [a1,6i] be one of these intervals on which f(a) is unbounded. Next divide J; into 
two equal subintervals by its midpoint; again f(a) is unbounded on at least one of these 
subintervals. Denote such an interval by Ig = [a2, b2]. Repeat the process in this manner to 
obtain a sequence of closed intervals satisfying 


1. [@n41,n41] C [Qn bn] (2 € N), 

2. by — Gn > 0 (as n > oo), and 

3. f(x) is unbounded on every [an, bn]. 
The nested interval theorem guarantees an x € [a,b] such that limp... dn = % = 
limp—+oo by. Now, for any 6 > 0, there is an integer N such that, ifn > N, [an, by] C 


(xo — 6,29 +6) [a,b]. Thus, we conclude that f(x) is unbounded on (2 — 6,20 +6) M [a,b 
as desired. 


Example 1.5. Let f : [a,b] —> R be a continuous function. Then f is bounded. 
Proof. For each x € [a,b], continuity implies that for each x there is a 6, > 0 such that 
\f(y) — f(x)| <1 whenever y € [a,b] and |x — y| < dy. 


Let I, = (a — dy, 2 + 6,) and 
G = {I,|x € [a, b]}. 
Then G is a open covering of [a,b]. By the Heine-Borel theorem, there exists a finite sub- 
covering G* of G that also covers [a, b]. Denote the components by 
G* = {(a1 — 61,21 + 41), (2 — 62, 22 + 62),-++ (Te — Ok, Te + SK)F- 

Let 

M = max{ |f(r1)| +1,|f(2)|+1,--- ,|f(we)| + 1}. 
We now show that |f(x)| < M for all x € [a,b]. To this end, for any x € [a,}], since G* 
covers [a,b], there is an index 7 such that x € I,,. Thus, 

|f(x) — f(@i)| <1 

and so 

f(x) S |F(@) — Fle) + [F(@a)l < 1+ |f(@)| <M. 


This proves that f is bounded as desired. 


Here the Heine-Borel theorem is used to extract the finite set G* from the infinite set 
G. This guarantees that we are able to select M. Because of the proprieties of compactness 
of [a, b], we will see in subsequent chapters why closed intervals are fundamentally different 
from open intervals. 
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1.2 Stolz-Cesaro Theorem 


To insure the adoration of a theorem for any length of time, faith is not enough, a police 
force is needed as well. — Albert Camus 


The following theorem provides a powerful tool to evaluate limits of sequences, and is 
viewed as a discrete form of L’Hopital’s rule. 


Theorem 1.13 (Stolz-Cesaro Theorem). Let ap, and by, be two real sequences. 
1. Assume that an > 0,6, > 0 asn— oo. If by is decreasing and 


‘ An+1— an 
lim —W——— = 


=a 
n—00 byt — by , 
where a is finite or +00, then 
; an : Qn+1 — an 
lim —= lim —— =a. 
nc b, =n>oo bn4y — by 


2. Assume that by, + +00 and by, is increasing. If 


: an+1— an 
lim ———— =a, 
n-700 bn41 = bn 
where a is finite or +00, then 
‘ an e An+1 an 
lim —~= lim =a 
noo by, n—0o On+1 — by 


Proof. Here we prove the case (2) with finite a only. The trick is how to estimate |an/b,—a| 
by grouping. To this end, for each € > 0, there is an integer N such that b, > 0 and 


Qn+1 — An 


bn41 x bn 


€ 
a| < 5 whenever n > N. 


Since bn+41 > b, for alln > N, we have 


(a = <) (bn+2—6w41) < any2—an4i < (a a =) (bv+2 — bn41), 


2 2 
€ € 
(a — =) (bw43 —bn+2) < Gn43—aNn42 < (a + =) (bv +3 — bn+2), 


(a = =) Cn ee Ae nin (a + =) Cay 


Adding these inequalities yields 


(a oa =) (On41 — bn 41) < Gn41 — G41 < (a “+ =) (On41 — bn +41), 


and so 
Qn+1 — @N41 


Dn+41 _ bn+1 
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Next, appealing to the identity 


Gn an+1 — aby+1 bn+41 Gn — GN41 
a= + {1 a}, 


br br br br — bn+1 
we have 
an QaN+1 — abny1 € 
a} < f=, 
by by 2 


Choose an integer N’ > N such that 


€ 


2 


an+1 — abn4+i 


whenever n > N’. 
bn 


Therefore, for each € > 0, when n > N’, we have 


an 
—-a 


<eé. 
Dn 


This proves that lim, +5. G;/by, = a as needed. 


The converse of this theorem does not hold, i-e., limp+oo dn/bn = a does not necessarily 


imply 
in 


n—700 bn+1 — bn 


Here is a counterexample: a, = 3n — (—1)",b, = 3n + (—1)”. For further discussion, see 
Section1.3.6. 


1.3. Worked Examples 


A good stock of examples, as large as possible, is indispensable for a thorough under- 
standing of any concept, and when I want to learn something new, I make it my first 
job to build one. 

— Paul Halmos 


The limits of sequences constitute an important part of the theory of limits. They pro- 
vide a preliminary step in our understanding of infinite series of numbers and functions and 
will underlie our future study of the continuity, differentiation, and integration of general 
functions. They also present wide classes of discrete processes arising in various applica- 
tions. In this section, we present 33 inspired examples with the expectation of using their 
solutions to develop common strategies and provide solid preparation for solving challeng- 
ing problems. Based on the various approaches used, we divide them into nine subsections, 
which are as follows. 


1.3.1 e-—WN definition 


For example is not proof — Jewish Proverb 


To show that limn_... Gn = a by using the e— N definition, we need to show that for any 
€ > 0, there exists a positive integer N that has the desired property: |a, —a| < € whenever 
n > N. To find such N, we typically operate on the inequality |a, — a| < € algebraically to 
try to “solve” for N. 
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Example 1.6. Let limp. Gy, = a, where a is either finite or infinity. Prove that 


_ A + GQ++** + an 
lim =a 


n—-0co n 


Proof. First, we assume that a is finite. Since lim,_... Gy = a, for any € > 0, there is an 
integer N; € N such that 


€ 
lan — al < 5 whenever n > Nj. 
Notice that, for each n > Ni, 


a, + ag++++ + An aa ei (a—a) | Diem (a) 
n n n ; 


Thus, 
a, +d. +++ +Gn a| < Nimaxisism (lai al} {ws Nie 
— T . 


n n n 2 


Since Ny max)<i<y, {|a; — al} is finite, there is an integer Nz € N such that 


Ni Max1<i< Ny, {la; a al} 2 c. 
n 


whenever n > No. 


Thus, for n > N = max{N,, No}, we have 


n 


Qa, +@g+°++'+Qn | € 
ay< 


This proves the claimed limit when a is finite. 
Next, assume that a = +oo. The case of a = —oo can be proved similarly. Thus, for 
each M > 0, there is an integer N € N such that 


Qn >3M ~~ whenever n> N. 


Moreover, 
Qa. agt +a, — A +agt':: Tan rien 4 1 N 
n 7 n n—N n 
ws N 
sa etl sm (1-2). 
nr n 


Notice that 
a1 +a2+°+:+an 


n 
There is an integer N’ > N such that 


N 
>O0, 1 »>lasn> oO. 


= 


a, +a2+-+--+aN gee M 
n 


1 
; > whenever n > N’. 
n 2 2 


Thus, when n > N’, we have 


and so 
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In this example, by regrouping and enlarging |a,, — a| appropriately, we solved for N from 


Ni Max1<i<N, {lai ad a|} 2 € 
N 2° 


Example 1.7 (Putnam Problem 1970-A4). Let a, be a sequence such that 
limp—+oo (€n — Gn—2) = 0. Prove that 
: Qn — An-1 
lim —— = 
noo n 


Proof. Let by = |an — Gn—1|. Since 


an — An-2 = an An—1 + Gn-1 an—2,; 


the triangle inequality yields that |a,, —a@y,—2| > |bn — bn—1|. Thus, limp.oo (@n — Gn—2) = 0 
implies that limp+oo [bn — bn—1| = 0. So for every € > 0, there is an integer N such that 


lbn — bn-i| < 5 whenever n > N. 


For this given N, there is an integer N’ > N such that 


b 
oN <= whenever n > N’. 
n 2 
Thus, forn > N’, 
Gn = Gn—1| _ bn Z pCO eas | | bn 
n no n n 
Zh Ne 42 € e 
eae eg 
This completes the proof. 
Applying Example 1.6, we can prove a stronger result: limp+5. “* = 0. Indeed, the 


assumption implies that 


Jim (@2n — aa(n—1)) = 9, Tim (dan+1 — @2n—1) = 0. 


In view of Example 1.6, we have 


in 8a _ 42+ (a4 — G2) +++ + (Gan — Ga(n—1)) 
lim — = lim = lim (aan — @2(n—1)) = 0, 
n->00 nN n—0o n n—0o 


and so lim, s. $" = 0. Similarly, we can show that lim, ... $4 = 0. 


1.3.2 Cauchy criterion 


Real mathematics must be justified as art if it can be justified at all. 
— Godfrey Harold Hardy 


The Cauchy criterion guarantees a sequence converges provided the terms accumulate. 
This is one of our primary tools for showing that a desired limit actually exists even if we 
do not explicitly know what it is. 
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Example 1.8. Forn€N, let 


Show that ay converges. 


Proof. For m,n €N and m>n, if m—n is odd, we have 


pepe re 1 1 
lam = On| = | oS n+2° m—-1 =| 
1 1 1 1 1 1 
“atl (5 =a) (a ani) m 
dell 
~n+ilin 


If m —n is even, we have 


lan = An| = lam Am—1 + Am-1 Gn| < |Qm—1 An| t i < + < 


Thus, for every € > 0, letting N > 1/2e yields 


|@m —@n|<¢€ whenever m,n > N. 


This indicates that a, is a Cauchy sequence. Therefore, a,, converges. 


We will see that a, actually converges to In 2 later. 


Example 1.9. Let a; = 1,a,4, =1/(1+a,),(n =1,2,....). Prove that a, converges and 
find its limit. 


Proof. By induction, it is easy to show that 1/2 < a, < 1 for all n € N. Thus, for any 
positive integers n and k, we have 


|Gn—1+k _ An—1| 
(1 + @n—14k)(1 + @n—1) 


1 4 
G+1/22 |Qn—14k a An—1| = 9 |@n—1+k — An-1}- 


lQn+k An| 


Repeatedly applying this inequality yields 


4 n-1 
lQntk — An| < @ |az — ay|. 


Since (4/9)” > 0 as n > on, it follows that a, is a Cauchy sequence. Hence a, converges. 
Denote its limit by a. Taking the limit in a,4; = 1/(1 +n) yields a* + a = 1. Therefore, 
a=(V/5—1)/2=0.618.... 


Remarks. The first 20 terms of the sequence are given by Mathematica 


flx_]:=1/(1 + x) 

NestList[f, 1, 20] 

{1, 1/2, 2/3, 3/5, 5/8, 8/13, 13/21, 21/34, 34/55, 55/89, 
89/144, 144/233, 233/377, 377/610, 610/987, 987/1597, 1597/2584, 
2584/4181, 4181/6765, 6765/10946, 10946/17711} 
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This suggests that a, = F,/Fin41, where F,, is the nth Fibonacci number. We can confirm 
this by a simple induction argument on n. In general, the recursion a,41; = 1/(1+a,) leads 
to 

aoFn—1 =F Fy 


; for a 0. 
aoFn + Fr4i we 


an = 
Example 1.10. (Example 1.1 Revisited). Show that ry = Fy,41/Fp is a Cauchy sequence, 
where F,, is the nth Fibonacci number. 


Proof. For any given « > 0, let N € N with N > 1/e. Assume that n,m € N with 
m>n> N. We have 


lrm —Tn| = Fmti _ #n+1 
aa F, 
Niet. Fe Vf Pi. Bs {Fs Fan 
. ( Fm A) | Ce aed ee | Fr ) 
FintiFim—1—F2, | FmFm—2— F241 | tee eee oan 
> Pee a Ds Sag Faia Ps 


Applying the identity Fy41F,—-1 — F? = (-1)* for k > 2, we find 


(-1)™ (-1)™-1 (—1)"*1 
lr'm —Tn| = | feet 

FypFm-1 Fy—1Fm_-2 Frsikh 

= | 1 1 4. (pr 
FF Fn42F nti Fm F'm-1 

1 1 
i Fy Fn41 a F, 
Since F,, > n for n > 5, we find that, ifn,m > max{5, N} with m > n, then 

| |< : < 2 = : < 
Se tg 


which proves that r,, is a Cauchy sequence by the definition. 


In the Cauchy criterion, be aware that the integer m must be arbitrary. Otherwise, for 
any given m, even though ajm,—an, — 0, ap itself may still diverge. Here is a counterexample. 


Example 1.11. For any increasing positive integer sequence $(n), there exists a divergent 
sequence a, such that 
lim (a(n) — Qn) = 0. 


n—->co 


Proof. By induction, we must have 
g(n)>n, don+k)>n+ ¢(k), for alln,keN. 


Thus ¢(n) > co as n — co. Next we separate into two cases: 

(1) {¢(n) — n} is bounded. ie., for every n € N, there is a number M > 0 such that 
o(n) —n < M. Let an = Hy := op_, 1/k, the n™ harmonic number, which is divergent. 
Then 


Th ees 
$(n) 
1 M 
= a< -0 asn-ow. 
k7~ n+l 
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(2) {¢(n) — n} is unbounded. Let ko be the smallest positive integer such that ¢(k) > k. 


Define 
Ae 1, n= ko, b(ko), O(O(ko)), «++ 5 
"" \ 0, otherwise. 


Clearly, {a,} has an infinite subsequence with the identical term 1. On the other hand, 
since {¢(n) — n} is unbounded, {a,,} must have an infinite subsequence with the identical 
term 0. Thus, a, diverges. However, by the definition of an, we have agin) = Gn. 


1.3.3 The squeeze theorem 
Truth is much too complicated to allow anything but approximations. 
— John von Neumann 


The squeeze theorem states that if sequences a,,,b,, and cy satisfy 


bn San <cp and lim b, = lim c, =a, 
noo noo 
then lim, 5.0 Gn = a. “Trapping” or “squeezing” a,, is based on inequalities. To obtain the 
identical limits of b, and cp, a quite precise estimate is often required. 


Example 1.12. Let a, > 0 for alln € N and limy.. a, = a > 0. Show that 
limpso0 7/102°**An = a. 


Proof. By the assumptions, we have limp... 1/an = 1/a. Applying the result of Example 


1.6 yields 
a, +42 +°+* + an 


a me 
and ' ‘ ; 
lm @ Fag TT ae = 
noo nN a , 
The later limit implies 
ee - =a. (1.2) 
ay a2 an 


Recall the AM-GM-HM inequality: If a,,a2,...,an € R are positive, then 


n ay +ag+-+++ an 
n ae! 
1, 1 heal T < ayag An S - : 
T T T 
ay a2 an 


The desired limit now follows from the facts (1.1), (1.2), and the squeeze theorem. 


Example 1.13. Find 


Solution. For x € (0,7/2), using the Taylor approximations of sinx gives 


x? . 
Te leneee are 


Equivalently, 


x<ecsex < ; 
ad ~ 6a — x3 
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Letting x = 1/k gives 


k<e : < a =k4 i eh 
ee EY) Oko ORS Se 


Summing this inequality for k from 1 to n leads to 


n 


1 1 1 1 
nin Fl) soso (7) ns: ) es ae 
k=1 


2 5 


where H,, := )¢y_, 1/k is the nth harmonic number. Dividing by n? and taking the limit 


as n — oo yields 
Wy ple 1 i 


k=1 


Example 1.14. Let 


Prove that limy +5 $n = In(3/2). 
Proof. We first observe that for all « > 0, 


x 


ene =< lntlcew) <2 (1.3) 


Setting x = 1/(2n +k) yields 


i <] 1+ : < 
—_——_—— < ln : 
2n+k+17— 2n+k)/~ 2+k 


Summing both sides for k from 1 to n gives 


NS 

3 

4 

a | 

+ 

eS 

IA 

wD 

3 

IA 
3 

iw) 

3 

ere 

os 


Rewriting 


1 
yields the Riemann sum of f(a”) = 1/(2+<) on [0,1]. Thus, we have 


1 1 1 dx 
li oa = In(3/2). 
iS (saa) ao fh aga?) 


Similarly, we have 
“ 1 
li wo 
eae », Intk+1 


= In(3/2). 


The desired limit now follows from the squeeze theorem. 
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1.3.4 Monotone convergence theorem 
We are here, in fact, a passage to the limit of unerampled audacity. — Felix Klein 


Similar to the Cauchy criterion, the monotone convergence theorem also enables us to 
show the convergence of a large class of sequences without seeing the values of the limits. 
Applying this theorem requires us to verify two assertions: 


1. a, is monotone. 


2. Gn is bounded either below or above. 


Example 1.15. Let H, := >7_, 1/k be the nth harmonic number. Define 
dy, := H, — Inn. 
Prove that limn.oo dn exists. 


Proof. Applying x = 1/n in (1.3) yields 


S| 


1 


Then j , 
dn4i1 dn = TG aL aU sl rare in(14 ) <o. 


This shows that d,, is monotone decreasing. On the other hand, 


n n—-1 3 2 
Get n(—2 B53) 
n—-1 
ie = a 
iy Ym (1+7) 
k=1 
n—-1 
1 
k=1 
1 
>->0 
n 


Hence d,, is bounded below. It then follows that d, converges from the monotone convergence 
theorem. 


Euler introduced the symbol ¥ as the limit of d,,, namely 


lim (H,, — Inn) = y = 0.5772156649..., (1.4) 
noo 
which is often called the Euler-Mascheroni constant. Similar to 7 and e, y appears frequently 
in many mathematical areas yet maintains a profound air of mystery. For example, although 
there is compelling evidence that ¥y is irrational, a proof has not yet been found. 
As an application of (1.4), the following elegant problem, due to Euler, presents a surprise 
link between the Euler sums and the Riemann zeta function ¢(n) := S77, 1/k”. 


Example 1.16. Let 


Find limn-soo En. 


24 Sequences 


Solution. Using partial fraction decomposition and shifting the summation index, we have 


k=1 
7 n Ay — Fes 
7 k k 
k=1 k=2 
” An -— Hei 1 
— 1 n 
5g Ds k n+1 


Example 1.17. Let 
P,(z) =a" +a" 1 4---42-1. 


Prove that P,(x) = 0 has a unique positive solution. Denoting this by ay, find limn.oo Gn- 


Proof. Notice that 
P,(0) = —-1, Phn(l) =n-1>0, Pi(x) >0 for x € (0,00). 


By the intermediate value theorem, there exists a unique a, € (0,1] such that P,,(a,) = 0. 
Now we show that a, is decreasing. To this end, since 


Pr(angi) = An41 + Onay re P ana = ol 


n+1 n 2 n-4 
= eaten + An+1 qe eee Qnt1 + Qn+1 — 1) ~ an4y 


n- 


n+1 _ +1 
Pr+1(@n+41) Ana = —Oy41 < 0, 


I 


it follows that P,(a,) =0 > P,(a@n41). The fact that P,,(#) is increasing in (0,00) implies 
that an > Gn41. Thus, by the monotone convergence theorem, limp+oo Gn exists. Appealing 
to the identity 


(2 —1)P, (2) = (e@ —1)[(2" 1 +2" 72 4+.) +24 Dae —1) = 27 - 22 +1, 


we have at! — 2a, +1=0. Thus 


0< Gy a ee 5 +0 asn—oo. 


This implies that lim,-,.. Gy, = 1/2 by the squeeze theorem. 


Example 1.18 (CMJ Problem 965, 2011). Motivated by Bernoulli’s inequality (1 + 
xz)" >1+nza for x > —1, let G,(x) = (1+ 2)" —(1+nz) for positive integers n. 


1. Show that for every odd positive integer n > 3 there is a unique negative real 
number x, such that Gy(an) = 0. 


2. Prove that the sequence £3,%5,%7,... is convergent and find its limit roo. 


Worked Examples 25 


3. Verify that for all positive integers n, even and odd, (1+2)" > 1+ na for 
LS Ly and that x, is the smallest number for which this statement is true. 


4. Show that yn — Go = O(In(n)/n). 


Here, as usual, a, = O(b,) means that there exist positive constant c and N € N such 
that |a,| < cb, for alln > N. 


Solution. (1) Clearly, G,(ax) is continuous. For odd positive integers n > 3, G,(—2) = 
2(n — 1) > 0 and limz_,-. Gn(x) = —oo. Thus, by the intermediate value theorem, there 
exists Up € (—oo, —2) such that G,(x,) = 0. Since 


>0, for xr < —2 
<0, for -2<2<0 


Gi(a) =n((1+2)""! 1) -{ 


G,,(a) is strictly increasing on (—oo, —2) and strictly decreasing on (—2,0). It follows that 
G,(x) > G,(0) = 0 for « € (—2,0), and so G,,(x) = 0 has a unique negative solution xp. 
2) We show that x3 < a3 < a7 <-+: < —2 and x = —2. For this part, assume that n is 
odd. Since G,,(a) is increasing on (—oo, —2) and 


1 n 
Gy (-2-=) = 2n — (1++) >0=Gr(tn), 
n n 


we deduce that 1, < —2—1/n. Thus, 


bay) = (12 )ae) 
b t,)°(1 + nea) — (+ (n+2)z,) 
2(2n+1+ntn) <0 = Gnio(tn42). 


Gnte2 (Ln) 


= ( 
= ( 
=2 
It follows that 7, < %p,42 < —2 for all odd positive integers n > 3. Thus limy_,oo Ly exists. 


Let yn(k) = —2—kln(n)/n, where & is a positive constant. For sufficiently large odd n and 
k > 1, we have yp(k) € (—3, —2) and 


Gn(Yn(k)) = (1 ! my" 1+2n+kIn(n) ~ —n*-14+2n+kIn(n) <0. (15) 


n 


Thus, t, > Yn(k) and 
5 kIn(n) 


1 
<&m<—-2-——-. 
n 


This proves that x. = —2 as desired. 
(3) We only need to show the inequality holds for —2 < x < —1. Indeed, 


(l+a)">—|l+a|">—-|l+a)=14+a>14 ne. 


If there exists at < —2 such that (1+#)” > 1+nt for all positive integers n, then G,(t) > 0 
for all n and so x, < t. Thus, rx. <t < —2. This contradicts that 7. = —2. 
(4) In view of (1.5), for large odd n, since 


we find that yn(2) < an < yn(1). It follows that x, — ro = O(In(n)/n) from the definition 
of Yn. 
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1.3.5 Upper and lower limits 
The essence of mathematics resides in its freedom — George Cantor 


Given a bounded sequence a,, we can always generate two convergent monotone se- 
quences. Indeed, define 


by = sup{Gy, p41, p42,---}, Ce = inf{ax, Qp41, Ap+2,---}. 


Clearly, 
by > bg-++ > bp > bey > Ceo > Ce 2 SQ > ch. 


Thus, by the monotone convergence theorem, both limg_,.. bp = inf{b,} and limg_.o0 Ce = 
sup{c,} exist. They are called the upper and lower limits of a,, and denoted by lim sup ay 
and lim inf a,,, respectively. It is easy to see that 


inf{a,} < liminfa, < limsupa, < sup{a,}. 


In the applications, the upper and lower limits are often described by the following equivalent 
forms: 


1. The lower limit lim inf a, = a is the unique number that has the properties 
e For each € > 0, there are finitely many ay’s such that a, <a-—e. 
e For each € > 0, there are infinitely many ap’s such that an <a-+e. 

2. Similarly, the upper limit lim supa, = 6} is the unique number that has the properties 
e For each € > 0, there are finitely many ap’s such that an > b+. 
e For each € > 0, there are infinitely many a,,’s such that a, > b—e. 

Moreover, ay, converges if and only if 
lim inf a, = limsup ap. 


The following three examples demonstrate how the guaranteed existence of the upper 
and lower limits offers us an additional bonus to finding the limits. 


Example 1.19. Let x, be a sequence satisfying 0 < min < @m+2n for allm,n EN. 
Prove that limy 5 &n/n exists. 


Discussion. The proof here is somewhat more involved than those we have encountered so 
far and we discuss some of the idea before presenting the proof. First, assuming that the 
limit exists, we want to see the possible values of the limit. For each k € N, repeatedly using 
Imtn <Lm + Ly yields that Lem < kx. Thus, 


0< —< —, (kyr = 1, 2,242.5) 
m m 
and so e . 
lim — = li nen. (m = 1,2, ) 
nc nN k- oo m m 
This implies that 
lim — < inf {==} 
no Nn 
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Proof. Since 0 < &min < fm + Xn, in particular, we have 
In 
O<a,<na, = 0< — <9}. 
n 


Thus, {%,/n} is bounded below, so a = inf{x,/n} exists. In the following, we show that 
limp—+oo Un/n = a. To this end, by the definition of the infimum, for any ¢ > 0, there is an 
integer N such that 


IN 
<—< 3 
as WN at+e 
When n > N, there are unique r and q such that n =rN+q (0<q< N). Thus, 
Uy StpNt+q STUN + LXq 


and x 
x x r x 
CO ccpetae een 2 <ate+ 4, 
~ n N rN+q n n 


The claimed limit now follows from the fact that lim,_,.. £,/n = 0 and the squeeze theorem. 


As in the Cauchy criterion, here the m and n must be completely arbitrary. Otherwise, 
assume that 


0<amin <Im+2n, for all m,n € N with |m—n| <k. (1.6) 
Choose A = {2™ : m € N}. Define 


_ fon, if dist(n, A) <k 
“n= 0, otherwise. 


Clearly, 
lim inf 2" = 0, limsup oe Sa, 
n n 


Thus, limn+oo @n does not exist. We now verify a, satisfies the condition (1.6). By contra- 
diction, if there are integers m,n > 1 such that 


lm—n| <k, Gmin > Gm +n, (1.7) 


this implies that either a, = 0 or a,, = 0. Assuming a,, = 0, for some positive integer r, we 
have 
yom yaa fay ae 


which implies 
W+k<nt+(n—k)<ntm<n+(n+m) < 2"*1—k, 


and SO @n4m = 0. This contradicts (1.7). 
The following example shows the link between the ratio and the nth root of the terms 
of a positive sequence. 


Example 1.20. Let x, be a positive sequence. If limn—+oo Un4i/Ln = |, prove that 


lim w/z, =l. 


noo 
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Proof. By the assumption, for every € > 0, there is a positive integer N such that 


<l+e  whenevern > N (1.8) 


For n > N, since 


which is equivalent to 
VEN (L— NI” < ofan < EN (+ 6) ON). 
Taking the upper and lower limits, and using the fact that limp... ~/%y = 1, we find that 
l—e<liminf yz, < limsup Yaz, <I+e. 
Since € is arbitrary, we deduce that 


liminf 7/x, = limsup */zy, = |, 


and so limp 56 Wty, = l. 


The above proof acutely demonstrates that, for any positive sequence Zp, 


dicted <liminf Yz, <limsup ~/z, < limsup aan 


In In 


lim inf 


Example 1.21. Assume the sequence x, is bounded and limn-yoo (Un41 — Un) = 0. Let 
(=liminf z,, DL =limsup zy. 
Let S be the set of limit points of the sequence {x,}. Prove that S = [1, L]. 


Proof. Since x, is bounded, the Bolzano-Weierstrass theorem implies that S is not empty. 
Moreover, S C [1, LZ]. If 1 = L, then limn-.. %, = liminf x, = limsup 2,. The assertion 
holds clearly. If! < L, it suffices to show that every a € (I, L) is a limit point of the sequence. 
Let 0<e < $min{a—1,L —a}. Then] <a—e<a<a+e< L. By the assumption that 
limp—+oo (@n+1 — Ln) = 0, there exists N € N such that 


|Un41—Xn| <2€,  whenevern > N. 


On the other hand, by the definition of the upper and lower limits, there are n{,n/{ > N 
such that 
Oa eile e) and aye (heb re). 


Without loss of generality, assume that n{ <n. Hence, 
Ln SA-ESAPTEK Ly, 
We now show that there exists n; € N satisfying ni <n; < n{ such that 


a-€<Xpn, <ate. 
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By contradiction, assume that rp 41,@n/42,---,Inv-1 ¢ (a—€,a+€). Let Xn 4p be the 
first such that 2,4) > a+ € among {Xp 41, Un" 42)-++)En"—1,; En}. Then 


Ln +p-1 <A@-€<AFE< Ly! 4p, 
and so 
IZni+p — Uni tp—1| > 2€, 
a contradiction. Thus, there exists %n, = In/ 4p) € (a—€,a+e), and so a is a limit point of 
Example 1.22 (Monthly Problem 12143, 2019). Compute 


n k k 
jim > (E) 


k=1 


Proof. We show the upper and lower limits both are trapped by e/(e—1). Thus, the desired 
limit is equal to e/(e — 1). We begin with the lower limit. Rewrite 


(2) = (SAY 


Since (1 + 2/k)~* is decreasing in k for x > 0, we have 


k 
k > ew (n-k), 
a 


Thus 

n k k n n-1 

ay |S BS —(n-k) _ m =n— 

» (5) > Ste ye (ase mi =n A), 

k=1 k=1 m=0 
and so 

1m 1m a => 
haa, Te e—1 


Next, for r € (0,1), let 
J={k:1<k<rn}, K={k:rn<k<n-—n"™}, and L={k:n—-n'8 <k <n}. 


For k € J, we have 


keJ 
For k € K, since r < k/n < 1—n7~?/3, we have 
2/3 


n k k n k rn 1l—-n oe a 1 rn+1 
S(t) <O(E) cnf ome=i-aa) 


kek kek 
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Moreover, using k/n = 1— (n—k)/n, we have 


n ni/3 _. 
x (*) =F 0-2)" (use m =n —k) 
keL sem 

ni/3 
= x exp ((n —m)In (1 - \) 
m=0 


II 
oO 
ia 
= 
| 
= 
lo} 
ia 
pon 
3 
bo 
ere 
= 
IA 
lo} 
ia 
= 
_ 
Sse 
3 
me 
aa 
<o 
Me 
fay) 
| 
3 


| 
io} 
ia 
se) 
— 
= 
ss 
3 
Ss. 
w 


“(k — Tr n 1 i ae e oii? 1/3) 
) t t xX n : 
n ~1l-r l+rn n2/3 e—l P 


Therefore, 


ae ga r e 
li —< : 
ims (T) ST 1 


Since r € (0,1) is arbitrary, letting r — 0 yields 


i pe e 
li =| < 
imow 32 (Ys 8 


as desired. 


1.3.6 Stolz-Cesaro theorem 


In Mathematics, you understand what you build up. — Fan Chung 


The Stolz-Cesaro theorem, similar to its continuous analogue L’H6pital’s rule, provides 
us a systematic method to calculate limits in the form of 0/0 and co/oo. Here we offer 
four concrete examples to illustrate the power of the Stolz-Cesaro theorem. We begin with 
revisiting Pdlya’s classical problem 173 in [77]. 


Example 1.23. Define the n times iterated sine function by 
sin, Z = sin(sin, 12), sin; x = sina. 
If sinz > 0, prove that 


A nn, 
lim —sin, x = 1. 
n—>oo 3 
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Proof. Sincesing < x forall x > 0, it follows that 0 < sin, x < sin, , « whenever sin x > 0. 
Thus, by the monotone convergence theorem, sin, x converges. Let limy_,.. sin, ® = a. 
Taking the limit in sin, x = sin(sin,_1 x) yields a = sina, and so a = 0. Define 


1 
An = 1, by = =z 
sin’, © 
By the Stolz-Cesaro theorem, we have 
i a) 7 nr : Qn+1 — an 
lim nsin, z= lim ——,;— = lim ———_. 
n—¥00 noo 1/sing x 2300 bri — bn 
Since 
An+1 — a . 1 
l = " = lim I 
aaa bn+1 ~ bn i oa sin2(sin;, x) sin? x 
: 1 : 
= lim — | 7; (t=sin, 2) 
t>0 — _— 
sin? t ad 
. t? sin? t 
= ii _ 
t0 ¢2 — sin“ t 
— 3, 


this proves 


lim [sina =,/lim nsin? 2/3 =1 
n—>0o 3 n—>0o 


In contrast to Pélya’s original approach, this solution is simpler and more straightfor- 
ward. 

The second problem is on the study of asymptotic behavior of a sequence generated by 
the logistic equation. This equation, which models population growth, was first published 
by Pierre Verhulst in 1845 [68]. 


as desired. 


Example 1.24 (Putnam Problem, 1966-A3). Let a4; = @,(1—2y),n =1,2,...,21 € 
(0,1). Show that limy.. N&p = 1. 


Proof. Since x1 € (0,1), we have x2 = x1(1—2 1) € (0,1). Indeed, by induction, we conclude 
that x, € (0,1) for all n € N. Notice that 


Tn+1 
In 


0< 


=1-a2, <1. 


Then x, is monotone decreasing and bounded below. It follows from the monotone conver- 
gence theorem that lim,.. ¢%, = LD exists. Letting n > oo in &p41 = &p(1 — xp) yields 
that L = L(1— ZL), which implies that L = 0. 

Let b, = 1/a,. Then by, < bp41 and limyn-+o0 by = +00. By the Stolz-Cesaro theorem, 


‘ nr ‘ 
lim na, = lim = lim : 
n—-co n—-co n n—-+>Co Dyyt = bn 


On the other hand, 


1 1 1 
lim bpy41 — bp) = lim ( _ +) = lim =] 


n> n+00 \ In41 Ln 


This shows that lim,_,.5 n%p, = 1 as claimed. 
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The above solution is differ from the one that appeared in Putnam Mathematical Com- 
petition Problems and Solutions [3, pp. 51-52]. The application of the Stolz-Cesaro theorem 
allows us to offer a short alternative solution. Moreover, combining this result with the for- 
mula (1.4), we have (see Exercise 89) 


fy, Ee ag, 
n—- oo Inn 

In general, the sequence defined by tn41 = Atp(1—2,) will display richer qualitative types 
of behavior for different values of A. The change from one form of qualitative behavior to 
another as \ changes is called a bifurcation. To learn more about the bifurcation study for 
the logistic model, please see Li and York’s landmark paper “Period three implies chaos” 
[67] or [51, pp. 92-101]. 

The third problem is the Monthly Problem E1557, 1963. Both published solutions 
are based on Stirling’s formula for n! and Riemann sums. Here we present an elementary 


solution by sorely using the Stolz-Cesaro theorem. 
Example 1.25. Let S, = (1/n?) y_4 MC* with Ck = n!/(k!(n — k)!). Evaluate S := 


lity 365. One 


Solution. Let an = op) n Ck, b, = n?. By the Stolz-Cesaro theorem, 


n+1 ke n k 
pao Chia — Dopey CE 


S= ii 
ace (n + 1)? = n2 
as fh k=O In (Ch41/CK) + In Oak 
n—0o 2n + 1 
— hae In(n + 1)/(n+1-—k) 
a (nt 1)in(nt 1) - DE, Ink 


Applying the Stolz-Cesaro theorem again yields 
(n+ 1)In(n+ 1) —nInn—- In(n+ 1) 


— li 
ae es (Qn +1) — (Qn—1) 
1 i" 
= lim 5m (= ) 
noo n 
a 
i) 


Finally, we derive a formula for the sums of the power of integers. It is based on the 


following well-known fact 
k41 


S,(n) = 2 i* = 2 a;(k) n? (1.9) 


for some coefficients a,(k). 
Example 1.26. Determine the coefficients a;(k) in (1.9). 


Solution. To find the leading coefficient az41(k), we divide (1.9) by n**?, isolate a,41(k), 
and then apply the Stolz-Cesaro theorem to get 
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Similarly, for 1 < 7 < k, we have 


Si (n) — Et) a;(k)n* 
a;(k) = lim K(”) Dinh (*) : 


noo nI 


Applying the Stolz-Cesaro theorem again yields 


Sk(n) — ety ai(k)n' 


a;(k) = lim 
f noo ni 
= |i (n + 1)* = ax41(k)[(n t 1)F+1 nk+}] ae aj4i(k)[(n 4 1)9+1 cag 
noo (n + 1)i _ ni . 


Since 
(n+ 1)? — n? = jn?! + Ofni-? ---41 


and a;(k) is well-defined, we deduce that all of the terms of order higher than j — 1 in the 
numerator must vanish while, all of the terms of order less than 7 — 1 have no effect on 
the limit. Thus, applying the binomial theorem and collecting the coefficients of n~! in 
the numerator gives 


Ch — ansa(k)Opy] — an(k)CZ* — ++ — agi (k) CRY. 
Therefore, 
sf) = Ce Ze IORET = aul RCE = += ayn BOF 
1 le | 
A 


This, together with a;,41(k) =1/(k +1), enables us to compute a;(k) recursively. 


In particular, we have 


1 1 1 
_ 2 +23 2 

So(n) = d, CSG yh Tm 

. 1 1 1 
S3(n) = D = i n+ —n3 + i n, 
S4(n) = y — : n n't n? : 

: a_i 307 

. 1 5 1 

ey P= =n ge 13 n! 3 n? 


1.3.7 Fixed-point theorems 


The most practical solution is a good theory. — Albert Einstein 
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As we have seen in Examples 1.9 and 1.24, sequences are often defined by recursion. In 
this case, once the initial term is given, each further term of the sequence is specified as a 
function of the preceding terms. More precisely, let f : R—-> R be a function. A recursion 
is defined by 

Lo = a(given), Mn41=f(%n), forneN. 


For example, the sequences in Examples 1.9 and 1.24 are recursions with f(x) = 1/(1+ 72) 
and f(x) = «(1 — 2x), respectively. This kind of feedback mechanism provides an example 
of dynamical system [51], a process that occurs naturally throughout mathematics and the 
natural sciences, especially in genetics and mathematical biology. The recursive sequence 


x, f(x), F(F(a)), FFF (@))),--- 


is called the orbit of x. In dynamical system, the main question we will ask in the sequel: 
given a function f, as the initial value x changes, what ultimately happens to the fate of 
orbits? It is usually quite difficult to tell by looking at a function where its orbits will go. 
The next two problems offer a sufficient condition for the orbits to converge to some limit. 


Definition 1.10. A function f : I — I is called a contraction mapping if there is a 
constant k, O0< k <1, such that 


If(z)-Ff@)| <kla—yl, for alla,y € I. (1.10) 


The following result, as a direct consequence of the Cauchy criterion, shows that a 
recursive sequence defined by a contraction mapping always converges. 


Example 1.27. Let f : [a,b] > [a,b] be a contraction mapping. For any x; € [a,b], define 
Tn+1 =f (ta); n= Ly2y.cs: (1.11) 


Then limn+o tn = x exists and satisfies f(x) = x (i.e., x is a fixed point of f, here x is 


left “fixed” by f). 
Proof. We first prove that x, is a Cauchy sequence. Indeed, for every p € N, we have 
|Zp+1 — Lp| = |f (ep) — f(p-1)| Sk |zp — Zp-il- 
It follows that 
[p41 _ Tp| < he 7 Lp—2| Sine RP |z2 — 24|. 


Then, for all m < n, 


lan — Lm < |an — fn—1| + |an-1 — Fn—2| +--+ + |[Sm41 — Lm 
< (kA ERM Eee $1) | x9 — | 
aed : km-1 
< ( > °) |x xy| = Tog | x4 |. 
i=m—1 


a 


Since k™-1! + 0 as m — ov, it follows that x, is a Cauchy sequence, so limy_,.5 nm = £ 
exists and x € [a,b]. Note that (1.10) implies that f is continuous. Letting n — oo in (1.11) 
yields that f(x) = x. 
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For a contraction mapping f, the fixed point of f is unique. Note that if f(z) = x and 
f(y) = y, then 
Iz —y| <If(x)- f@) < hla — yl. 
This is impossible unless « = y. It is worth noticing that the result still valid if [a, 6] is 
replaced by [a,oo) or R. The above result is often referred to as the contraction mapping 
principle or the Brouwer fixed point theorem in advanced analysis. 
Let f : TI be a differentiable function for which 


If(z)|<k<1, forallvel. 


The mean value theorem implies that f is a contraction mapping. It is crucial that k is 
strictly less than 1. Otherwise, let f(z) = V1+2?,a € R. We find that |f’(x)| < 1, but 
lim)z|-00 |f’(w)| = 1 and f has no fixed point in R. However, if J = [a,], there is a 
remarkable application of the Bolzano- Weierstrass theorem and the monotone convergence 
theorem that allows us to relax (1.10) a little bit and prove the following fixed point theorem. 


Example 1.28. Let f : [a,b] — [a,b] for which 
If(x)-Ff@)l<|e-yl, for allx,y € [a,b],a Fy. 
Then, for any x1 € [a,b], the sequence defined by 
Cy = foe) eH 1,2) as): 
converges to the unique fixed point of f(a) in [a,b]. 


Proof. Let 
D(x) =|f(x)-—2|,  « € [a, dD. 


D(a) is continuous on [a, 6], and if « £ f(x), we have 
D(F(@)) = |F(F@)) — F@) < If) — 2| = Di). (1.12) 


Notice that x, € [a,b] by the assumption of f. It then follows from the Bolzano- Weierstrass 
theorem that there exists a subsequence xn, — po € [a,b]. Thus, 


D(%n,) + D(xo), D(tn.+1) = D(f(@n,)) + D(20)- 
On the other hand, by (1.12), 
D(tn41) = D(f(#n)) < D(an), 


so D(x,,) is monotone decreasing and nonnegative, and therefore it converges by the mono- 
tone convergence theorem. Since D(x», ) and D(#n,41) are subsequences of D(x), we find 
that D(f(xo)) = D(ao). It follows from (1.12) that f(%o) = ao. i-e., xo is a fixed point of 
f. Next, if 9 = f(xo0), yo = f(yo), then 


|to — yol = |f (xo) — F(yo)| < |zo — yol, 


which is impossible unless xp = yo. Therefore, the fixed point is unique. 


If we replace the recursion 2,41 = f(Xn) by 
Inti = AL, +(1—a)f(an), (where 0 <a <1), 


for any x1 € [a, b], the sequence x, also converges to the unique fixed point of f. See Exercise 
81. 

The above two principles can be applied to establish convergence of large classes of 
recursions. 
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1. Define 71 = 1,¢n41 = V1 +, (n =1,2,...). 
Let f(z) = /1+4+ a. For x > 0, we have 
1 


2V1l+2 
Thus, f is a contraction from [0,2] to [0,2], so x, converges and limy +... tn = 
(1+ V5)/2. 


2. For a > 0, it is well-known that the following recursion 


1 a 
Tn+1 = 3 («+ =) ; 


which is based on Newton’s method, offers a quick approach to approximate \/a. 
Here are two more recursions as both converge to /a: Let a > 1. 


i = 1 
s"@l=| Ze 


er >0, tr41 =a(1+2,)/(a+ 2). Using 


fle) = CD) : (0,00) — [0, 00), W@<1-2 <1. 


et > Va, tn41 = (@+2,)/(1+ 2p). Using 


a+z a-1 
f(a) = = 5 [Va,c0) 5 [Va,00), |f"(@)| $5 <1. 
It is interesting to notice that x, defined in the second recursion is not monotone. The 
confirmation of convergence by the method consists of proving that both v2, and %2n41 are 
monotone and converge to the same limit. 

In general, assume f : I > I with f’(x) <0 for all x € I. Let x be the only fixed point 
of f in I. For the recursion sequence £n41 = f(Xn), by the mean value theorem, we have 


In41—-© = f (an) — f(x) = f'(€)(an — x), (where € is between x, and 2). 


This indicates that the sequence x, is oscillating around the fixed point x. Now, let F(a) = 
f(f(x)). Notice that F’(x) = f’(f(a))- f’(x) > 0. The recursion 
Tn+2 = F (xn) 


yields two monotone sequences £2, and %2,+41. Both will converge to the fixed point of F 
provided that F is a contraction. 

We end this subsection by presenting an example where the contraction mapping prin- 
ciple is applied to subsequences. 


Example 1.29 (Putnam Problem 1953-A6). Show that the sequence 


Aiyiiyr—yredayr— fray. 


converges and find its limit. 


Proof. This continued radical has period 2. Thus, let f(z) = V7 —/7 +2. Clearly, f maps 
[0, 7] into [0,7]. Starting with ay = V7 and x; = \/7 — V7, and appealing to the recursion 
In+2 = f(Xn), we obtain two sequences x2, and Lan+41. Since 


= k = 0.052347..., 


f'(«)| = 


Ba) 1 
4A/7—-V7+a-V7+a = 4/7 —VJ14 V7 
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f is a contraction mapping. Thus, both x2, and xv2n41 converge to the unique fixed point 
of f(a) in [0,7]. Notice that x = f(x), x € [0,7] implies that « = 2. Thus, we find that 
In XO 2asn> oo. 


Continued radicals were a favorite topic of Ramanujan. One of his famous results 


lima aaa = 


appeared as Putnam Problem 1966-A6. One general closed form is given in Exercise 98. 
For two tests for convergence of continued radicals, see Exercises 106 and 107. 


1.3.8 Recursions with closed forms 


Structures are the weapons of the mathematician. — Nicolas Bourbaki 


We now turn our attention to second-order linear and nonlinear recursions. We begin 
with a simple linear second-order recursion: 


Ln + XLn-1 


2 


1 1" 1\" 
n+ 1 Ln = 2 (Ln Lit) aa (-5) (xy = Xo) im (-5) ; 


we can show that x2, is monotone increasing and %2n+1 is monotone decreasing. Moreover, 
both subsequences converge to the same limit. Therefore, x, converges. When we try to 
determine the value of the limit as we did before, we find that taking the limit in (1.13) 
does not gain the desired answer. The following problem presents an alternative approach 
to solve general second-order linear recursions. It simultaneously provides the convergence 
and the limit value. The method is based on establishing a closed form for the general terms. 


ro = 0,21 => 1,@n41 = (1.13) 


Based on 


Example 1.30. Let a1,a2 € R with a? + a3 4 0. Define 
Gnt1 =AG,+ba,-1, nEN n> 2, (1.14) 
where a,b > 0. Find limn+oo Gn41/An- 


Solution. The idea is to seek solutions of the form a, = r”, where r is a constant to be 
determined. The substitution of a,_, = r"~! and an41 = r"t? into (1.14) reduces the 
problem to finding r from the quadratic equation r? — ar — b = 0. Let these two solutions 


be 
a+vVa?+4b a — Va? + 4b 
a= ; B = ’ 
2 2 
respectively. Then 
a+f=a,a-f=—b. 
Replacing a,b in (1.14) in terms of a, 6, we have 
antl —~ Aan = B (Qn — @Gn-1), (n = 2,3,,°°-), 


I 


An+4+1 — Ban Oda — Pant), (n = 2,3,,°--). 
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Repeatedly applying this process yields 


An+1—-— Adn = ems (a2 — aay), (n = 2,3,,-°-), 


Anti — Ban = ot (az — Bay), (n = 2,3,,---). 


Solving for an+1 gives 


_ a” (ag — Bay) — B” (az — aay) 
Qn4+1 = . 


a—p 


If ag — Ba, = 0, we have an41/a, = 8 for all n € N and so limy_.o6 Gn41/an = 8. 
On the other hand, if az — 8 a, 4 0, in view of the fact that |a/8| > 1, we can choose n 
large enough such that 


a ag —-— aaj, 
B a2 — Bar| 
We find that a, 4 0 and 
Ont1 _ a” (az — Ba) — B" (az — aay) 
An a”—! (ag — Bay) — 8"! (ag — aay) 


Since |3/a| < 1, we obtain that limp 546 Qn41/adn = a. 


Let a = b = 1 in (1.14) with a; = ag = 1. We obtain the famous Binet’s formula for the 


Fibonacci numbers: 
1 Wega fins \" 
i . 
V5 2 2 


Let a+b =1 in (1.14). We have a = 1, 8 = —b, and 


= ag + bay, _ (—b)"-!(ag _— a1) 


Qn ae : 
Therefore, 

li ay + bay 

im apn = 


In particular, for the recursion (1.13), we find that limy_,.. &, = 2/3. 
Remark. The approach used to find the explicit formula of a,41 can be transformed into 
computing the powers of a matrix. To see that, we rewrite (1.14) in a matrix equation 


x) = Ax) n=3,4,..., 


x!) — mars r x(r—-1) — an and A= a b . 
an An—-1 1 0 


From the matrix equation above, it follows that 


where 


x) = Ax(-2) — 42x(n-2) an (@), 


ay 
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Consequently, if we can find an explicit expansion for A”~!, we can obtain an explicit 


formula for x), and so for dn41- To find an explicit expansion for A"~!, we first diagonalize 
A. Clearly, aw and § are eigenvalues of A; their corresponding eigenvectors are 


respectively. Thus 


We then have 


Therefore, 


n if a B ant 0 1 —6 a2 
Se) oe) aa) 


a” (ag—B a1)—B” (ag—a ai) 
a—B 
( ant (az—B.ai1)—B"~+ (ag—a a1) 


a-B 


l| 


The first component of x‘) reveals the formula of a1 again. The method of computing 
the powers of a matrix enables us to handle the multivariable recursions. See Exercise 70. 

The following example shows how a nonlinear recursion can be transformed into a linear 
one. 


Example 1.31. Let a, £0 be a real sequence such that 
az—1 


an—-1 


AQn+1 = (v= T2323.) 


Prove there exists a real number a such that an41 = AAn — Gn—1. 
Proof. We work backward by rewriting the desired result as 


= An+1 + aAn-1 
an 


It suffices to show that, for all n € N, 


An+1 + An-1 
an 


= constant. 


To this end, for any integer n > 1, notice the given recursion implies that a2 —An_1An41 = 1. 
Thus, we have 
2 2 
An+1 — GnAn4+2 = An — An—-14n+1- 
Regrouping yields 
An4+1(Gn+41 =p Gn—1) _ Gn (Qn+2 a Gn). 


This is equivalent to 
An+1 + An-1 _ An+2 + an 


an An+1 


which proves that (@n41 + @n—1)/@n is the required constant a. 
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In certain cases a sequence defined by a nonlinear recursion may still yield a closed form. 
Connections with trigonometry and hyperbolic functions may be useful for recovering these 
forms. For example, for the logistic equation 2,41 = 42%,(1—2,), appealing to the identity 
sin 2a = 2sinacosa, we have x, = sin?(2"6) for all n € N, where 6 = sin” '(,/r7)/2. We 
present two more examples as follows. 


Example 1.32 (Monthly Problem 11604, 2011). Given 0 < a < 2, let {a,} be the 
sequence defined by a, = a and Gn41 = 2" — \/2"(2" — an) forn>1. Find ~~, a 


Solution. First, we show by induction that 
An = 2” sin?(0/2"), (1.15) 


where 6 = 2sin~!(,/a/2). For n = 1, the definition of @ yields that a; = a = 2sin?(0/2). 
Assume (1.15) is true for n = k; the half angle formula for sine gives 


api, = 2" = 2k(2 — 2k sin?(9/2*)) = 2*(1 — cos(@/2*)) = 2**" sin?(6/2**7), 


Thus, by induction, (1.15) holds for all positive integers. 
Next, using the fact that 


sin* x = sin? x(1 — cos? x) = sin? « — ; sin? (22), 
we find that 
a2 = 2?" sin*(9/2") = 2?" sin?(9/2") — 22-) sin?(9/2"-1), 
Thus, the proposed series is telescoping and 


oe) 
da 
n=1 


Co 


2d (2?” sin? (G/2") = 22) sin?(6/2"~')) 


I 


= “im. (Qe sin? (9/2) — sin?(0)) 


= @—sin?9= [4 sin“ 1( a/2)) —a(2—a). 


Example 1.33. Let a, and ag be positive real numbers. Define 


— A2n + G2n-1 
G2n4+1 = a) n=1,2,..., 


an = /G2n-1 “A2n—2, N= 2,3,.... 
Find limn_so0 Gn- 


Solution. We separate into three cases: 

(1) If a1 = ag, the given recursion implies that a, = a, for all n € N. Hence lim... Gn = a1. 
(2) If a1 < ae, construct a right triangle with adjacent leg a; and hypotenuse ag. Let 
6 € (0,7/2) be such that cos @ = a;/az and a be the opposite leg. Then 


a, =a cotd, ag =a cscO; 


6 = cos ‘(a;/az), a = +/ a2 — a?. 
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Appealing to the trigonometric identities, for 0 < a < 1/2, 


cot(2a) + csc(2a) _ 1 cota 1 
5 a cota, 4/csc(2a) - 5 9 C8, 
we find that 
6 
Qantl = moot (=), WS Ly i2y reas 
0 
don = yi csc (sx) om S253; 
Since 
r li 2 
es Qn os Qn v eesti Qn-1 oe Qn-1 7 6’ 
we have 
az — at 
li n=-= 2 
noo 6 cos~!(a,/az) 
(3) If ay > ae, using the identities 
th(2 h(2 1 th 1 
eqUngy ceca) = — cotha, i[eseh(20) eee = —cscha, 
2 2 2 2 
similarly, we have 
2_ 72 
lim ayn = a 
n—00 cosh” “(a1 /az2) 


Finally, we present an example to study a nonlinear recursion (without a closed form) by 
determining its asymptotic behavior. Two interesting solutions have been published in the 
Amer. Math. Monthly (October, 2013) and Math. Mag. (Vol. 86, No. 1, 2013), respectively. 
Here we give another one solely based on the Riemann sums. 


Example 1.34 (Putnam Problem 2012-B4). Suppose that ag = 1 and that an41 = 
dn +e forn =0,1,2,.... Does an — Inn have a finite limit as n + oo? 


Solution. We show that a, —Inn > 0 as n > oo indeed. It suffices to show that e* /n > 1 
as n — oo. To begin, notice that a,, is strictly increasing. Partition [a9, a,] with subintervals 
[ap—1,@x],k = 1,2,...,n. Since e® is increasing, appealing to a, — az_, = e~**-1, the 
Riemann sum with the left endpoints gives 


an n ak 
esen | edz = / e” dx 
a k=l ¥ @k-1 


0 


n 


n 
> So e% (ay —ax—1) = > 1 
k=1 


k= 


I 
= 


It follows that a, > In(e +n) > Inn for all n € N and 


an 


€ 


Sie (1.16) 
n n 
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On the other hand, the Riemann sum with the right endpoints yields 


0 k=l % @k-1 
n n n 
SP a) eam) a 
k=1 k=1 k=1 


Notice that e%*-! > (k — 1) +e>k from above. Thus, e~%*-! < 1/k and 


n n 
cm ex elt ces | el/® dx. 


k=1 : 
Hence, 
ae 2 tf” 
ee / el/™ dr. (1.17) 
n no ony 


Notice that, for example, using the Stolz-Cesaro theorem, 


1 n 

lim -| e/® dx = 1. 
noo 1 Jy 

Now, e*" /n + 1 as n > co follows from (1.16), (1.17) and the squeeze theorem. Therefore, 


Jim, (a, — Inn) = 0. 


This problem is an example of the general principle that one can often predict the asymp- 
totic behavior of a recursive sequence by studying solutions of a sufficiently similar-looking 
differential equation. In this case, as Kedlaya and Ng suggested in http://kskedlaya. 
org/putnam-archive/2012s.pdf: We can start with the equation an41 — an =e”, then 
replace a, with a function y(a) and replace the difference an41 — a, with the derivative 
y’(x) to obtain the differential equation y’ = e~¥, which has the solution y = Ing. As a 
continuation of this problem, we consider 


Example 1.35 (Monthly Problem 12270, 2021). Let aj = 1, and let an4; =a,+e°% 
forn > 0. Show that the sequence whose nth term is e@ —n— (1/2)Inn converges. 


Proof. Let b, = e*” for n > 0. Then 


Bap = eentt = emte™™ — B el/bn. 


Using the power series expansion of e” and Taylor’s theorem, we have 


1 
ba bt PR 
41 tore 


where 0 < R, < M/b? for some positive constant M. Since bo = e“° = e, telescoping the 
equation above from 0 to n — 1 yields 
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In view of the fact that e**(ax41 — ax) = 1, we have 1/by = ap4i1 — ax. Telescoping again 
gives 


1 n—1 n—-1 
bn — MT (an41 — an) + >> Rr 
k=0 k=0 


n—1 
1 
= e+tn+t+ gan) + >, Ry. 
k=0 


Hence 


1 1 1 
ee —n— 5lnn=e 5 + (an Inn) ye 


Using the fact that a, — Inn — 0 as n > oo from Example 1.34, we find that 
li ne oy : + Y R 
im ({e°" —n——-lInn]} =e--= ee 
n=900 2 2° a m 


This shows that e* —n—(1/2) Inn converges as b, > k+e implies that 0 < Ry < M/(k+e)? 
and then the series )>7° ) Ry, converges. 


1.3.9 Limits involving the harmonic numbers 


The profound study of nature is the most fertile source on mathematical discoveries. — 
Joseph Fourier 


Recall that, for each n € N, the nth harmonic number Hy, is defined by 


1 1 1 | 
HH, =14 pared — = ‘ 
973 n dak 


Although there is no closed formula of H,, for general n, by Example 1.15, we have 


lim (H,, — Inn) = 4, 


n—- co 


where y is the Euler-Mascheroni constant. A detailed history on H,, and its development 
are very well described in Havil’s book [55]. Since H,, appears so often in analysis and many 
consequences can be drawn from it, so it is worthwhile for us to take a closer look at H,,. We 
begin with an identity that associates the harmonic numbers with the binomial coefficients. 


Example 1.36. Show that 


n= 3 (OE 


k 
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Proof. Observe that 1/k = f, v*-1dz for all k ¢ N. We have 


Let Hi?) = Y7?_, 1/k?. We further find that 


k=1 
n\ (-1)*¥-? 1 
= -(H? + H) 
” pets 
S- & oie ? = (13 +3H, He +200). 
k=1 


We leave the proofs to the reader. 

The next two examples demonstrate how to manipulate the limit problems involving 
the harmonic numbers. Some interesting identities such as (1.19)—(1.21) will be established 
along the way. 


Example 1.37 (CMJ Problem 1211, 2021). Evaluate the following limit, where below, 
Ho = 0 and for n > 0, H,, denotes the nth harmonic number 77_, 1/k: 


“A 
7 2 n—k 
std (1 as ) 
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So := 0, and 
m—-1 m—2 
mk Am—1—k 
Sm “a Sm- = 
: k me k 
k=1 k=1 
= ee Amr az Ay —K-1 _ ee 1 
| k = k(m—k) 
m—-1 m-1 
1 1 1 
= ; ame :) (use partial fractions) 
k=1 k=1 
eg 
a — (use the symmetry) 
m k 
k=1 
2Am—1 2H», 2 
~~ mm m? 


Sn = 3 Beg > it oD, (1.18) 


k m m? 
k=1 m=1 m=1 
On the other hand, we have 
n mn n a n n 
~ ~ 1 ~ 1 ~ 1 ~ 1 1 
H? = = i 
i a ij i\ oj eS j LR 
t=1 g=1 t=1 g=l j=t t=1 
n t n n n 
1 1 1 A; 1 
=2 = ee = =2 os S > 
1—~yJ a 5 a i 7, 
t=1 j=l t=1 w=1 w=1 


Fy eRe 
-=H?-S°S. (1.19) 


Hence, 


Example 1.38 (Math. Magazine Problem 2136, 2022). Evaluate 


= He\ Hn 
a (>: z| : ) : 


Solution. We show that the limit is 3¢(3), where ¢(3) is Apéry’s constant defined by 
¢(3) = OP. 1/k?. To this end, we first show that 


He = CHE ig: "A ey 
Pat = Daas (1.20) 
k=1 k=1 
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we find that 


as claimed. 
To prove (1.20), let a, = 1/k,b,y = HZ. Then A, = oe a; = Hy. Applying Abel’s 


summation formula 


n—-1 
See bn +S> An( (bi — be41), 
k=1 k=1 


we have 


n—- 


s- oe = Hb 4+ S- Ay (Hy — Hiss) 


= 1 1 i 
= H8— 0 (Hes gq) (ee - a) 


n—-1 772 n-1 n-1 
A. Agy1 1 
— 7B_2 k4+1 + 
pee Gade (k4+ 13 

k=1 k=1 

_ 7 ky k 

= A, 200 paw 3 k2 3 k3 
k=1 k=1 k=1 


This leads to 


which yields (1.20) as desired. 


Remark. Along the same lines, we can prove that 


n (4 ey 1 3 eee 
yap ere) pa je > gfe. m2) 


k=1 
Therefore 
n H) 
im, S- coe : (uP): = Yp,2p — +6(3P) (1.22) 


which is often referred as the Euler sums. Since $2.4 = ¢?(3) — ¢(6)/3, we have 


; . (#) 1 (pay\? | 
Be em 
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AT 


In general, based on [18], if p is odd, S,,2, can be reducible to Riemann zeta values, so we 
can find the limit in (1.22) in terms of the Riemann zeta values. 


1.4 Exercises 


The only way to learn mathematics is to do mathematics. — Paul Halmos 


1. 
2. 


Prove the Cauchy criterion and the Heine-Borel theorem are equivalent. 


Use the least-upper-bound property to prove the Heine-Borel theorem. 
Hint. Let G be an open covering of [a, b]. Define 


S={s>a: There is a finite sub-coveing of G that covers [a, s]}. 


Show that S' is nonempty and b€ S. 

Let G be an open covering of [a,b]. Prove that, for any 71,22 € [a,}], there is a 
6 >0Oand U €G such that 71,72 € U whenever |a1 — x2| < 6. The number 6 is 
called the Lebesgue number of G. 

Let f : [a,b] — [a,b] be increasing. Use the nested interval theorem to show that 
there exists c € [a,b] such that f(c) =c. 

A function f : I > R is called locally bounded on I, if for each point x € I there 
is a 6 > 0 such that f is bounded on (4 — 6,4 +6) OT. 


(a) Show that f(a) = 1/z is locally bounded on (0,1), but it is not bounded on 
(0, 1) 

(b) Show that f(a) = a is locally bounded on [0,00), but it is not bounded on 
(0, co). 

(c) Show that if f is locally bounded on [a,b], then f is bounded on [a, b]. Hint: 
This can be done by using one of Theorems 1.7, 1.8, and 1.12. 

A function f : I > R is called locally positive on I, if for each point « € I there 

is ae > 0 such that f(y) > ¢ for all y € (x — 6,4 +6) NI. When I = [a,b], show 

that there exists some constant c > 0 such that f(a) > c for all x € I. 


For n EN, let 


1P + 3P +--+ +(2n—1)P 
(2n + 1)P + (2n+3)? ++-++ (4n— 1)?" 


an = 


Prove that a, is increasing for p > 1 and decreasing for 0 < p < 1. 


Let a, be a real sequence. Define 


— a + a2 +++ + An 


n= 


n 


(a) Show that 
lim inf a, < liminfo, < limsupo,, < limsupa,. 


(b) If a, is increasing and limp... On = a, show that limp. Gn = a. 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 
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(c) Find a counterexample to show that the increasing assumption in (b) is 
necessary. 

(Putnam Problem 2001-B6). Assume that a, is an increasing sequence of 

positive real numbers such that limps. os = 0. Must there exist infinitely many 

positive integers n such that 


Oni Hens < 2a, forg=1,2i..5n—1? 


(Putnam Problem 2002-A5). Define a sequence by ap = 1, together with the 
rules dan41 = Gn and dan+2 = An +Gn+1 for each integer n > 0. Prove that every 
positive rational number appears in the set 


ort sn >iba{ss 
An 2 


(Putnam Problem 2018-B4). Given a real number a, we define a sequence by 
t= 1,21) = 22 =a, and &n41 = 2EpXpn_—1 —Xn_—2 for n > 2. Prove that if x, =0 
for some n, then the sequence is periodic. 


Given 21 € R, define tp41 = &n(an +1/n) for n € N. Prove that there exists a 
unique x; such that 0 < tp < @n41 <1 for every n. 


Given x; € R, define 2,41 = 2” — 3x, for n € N. Find all possible value(s) of 21 
such that the sequence z,, is strictly increasing. 


Consider the sequence x, defined by x1 = 2, %n41 = 1/4+ 2p — x2 forn EN. 

(a) If « = 0, show that x, is monotone increasing and bounded, then find 
limnsco Ln- 

(b) Find all possible value of « such that limy-.o Un exists. 


Given 7; € R, define t,41 = @%,(2—2,) for n € N. Prove that if x, € (0,1), then 
the sequence x, monotonically converges to one of the steady-state solutions (i.e., 
the fixed point of f(a) = #(2—<«)). 


(Monthly Problem 12220, 2020). Let a, = Sop_, 1/k* and b, = 
re 1/(2k — 1)”. Prove 


Let a, = a and 
A+ Ban 


B+ Gn 
If a? < \ < 8, show that a, converges and find its limit. 
Let a,a, > 0 and ne€N. Define 


Qn41 = forn EN. 


3a2 +a 


Show that a, converges and find its limit. 
For A > 0, let 


i. 1 
a1 = 5, Anti = 5(A + an); (n= 1,2,---). 


Determine limy_.oo An- 


Exercises 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 


Let a, = 0,a2 = 1 and for n> 3 
Gn = (n— 1)(Gn—1 + Gn—2). 
Find a closed form for a, and evaluate limp... a,/n!. Here a, is the number of 


derangements of a set of n objects. 


Let a; = ag = 1 and forn>1 


An+2 = NAn+14n- 
Show that 
Giga 12 tee li 1), 
where F;, is the nth Fibonacci number. Can you find an asymptotical expression 
of a, for sufficiently large n? 


Let a, = 6 and any, = a? + (1 — 2a)ay, + a? for n € N. Find all possible values 
of a and § such that the sequence a, converges, and also determine the limit. 


Suppose that a, has the property that for any a > 1, the subsequence 
Aan} > 0 asno, 
where || is the greatest integer not exceeding x (for example, |3.14] = 3). Does 


the sequence a, itself necessarily converge to zero? 


Determine 


where {x} = x — |x| is the fractional part of x (for example, {3.14} = 0.14). 


(Monthly Problem 12153, 2020). For a real number x whose fractional part 
is not 1/2, let (x) denote the nearest integer to x. For a positive integer n, let 


n 


1 
BD ag 


(a) Prove that the sequence a, is convergent, and find its limit L. 
(b) Prove that the set {,/n(ay, — L) : n > 1} is a dense subset of [0, 1/4]. 
For n € N, define 


1 1 
Anti = 5 +67), Bnt1 = 3 (24n =i) 


If 0 <b, < 1/2 < ay, show that both a, and b,, converge and find their limits. 
Let a, > 0 for all n € N. Define 
ay, ag an 


Sn =A, +QG9+°':+QAn, tn= + Fists: : 
$1 $2 Sn 


Show that lim,,_,., 5, = co implies that lim,_,., th = co 


Let limn+oo Gn = a. For jal < 1, find 


lim (an + Gn—10 + Gn_207 +--+ + aga”). 
nN oo 
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29. Let limps. dn = a and limy-+.. by = b. Show that 


: ay bn—1 + Agbn—2 +++ +Gn—161 
lim 


noo n 


= ab. 


30. Show that if p, > O(n =1,2,...,) and 


: Pn 
lim 
n>co py + pa t-*++ Dn 


=0, lim an, =a, 
noo 


then 
ere a + pedg r++ Pndn 
im =a 
n—090 Pi t+ pa+e+++ Pn 


31. Let a, and 6b, be positive sequences. Assume that 


_ a + ag4++** + Gn by + bg +++: + bn 
lim = 


n—0o Nan n—oo nbn, 


=b 


anda+b> 0. Find 


; a,b + 2agb2 ee Nandy 
lim . 


noo n2anbn 
32. Let limp soo Gn = 4, by > 0, and limy_... (by + bo +--+: +b,) = B. Prove that 


lim (dn by + An-1 bo tree ay bn) = ab. 


33. (Toeplitz Theorem). Let n,k ¢ N. Assume that 
(a) Unie eae tik = 1, limy—+o0 tnk = 0, and 
(b) limp+oo Gn = a. 
Prove that 


n 
lim y tnedk = a. 
noo 

k=1 


34. Let limp... Gn = a. Evaluate 


where (4 = is the binomial coefficient. 


n! 
k! (n—k)! 
35. For n EN, let 


Show that 


(a) forn >2,a, =1+4+ ntl q,_4, 


_ n+l n+1 9* 
(b) @n = gett pn E> 


(c) limpyoo Gn = 2. 
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36. 


37. 


38. 


39. 


AO. 


Al. 


42. 


43. 


For n € N, show that 
1 2Qn+1 Qn+1 2% 
(a) es (27) = Siar pa k+1? 


(b) ee ak — (n41)a"t1 n+1 (1+20")(e+1)* 


(7) ~~ (a+1)rF2 k=1 kak 
For n € N, show that 
(a) For n> 83, 


w(t eg) <s<m(i4 ro), 


Find limy_..o NG. 


Let a9 = 0, dn41 = 1+sin(a, — 1) for all n € N. Find 


_ G+ a2 ++*' +n 
lim ; 


noo n 


(Putnam Problem 2016-A2). Given a positive integer n, let M(n) be the 
largest integer m such that 
m % m—1 
n-1 n j 
Evaluate limy_—+o6 


(Monthly Problem 11528, 2010). Let p,a, and b be positive integers with 
a < b. Consider a sequence a, defined by nan41 = (n+ 1/p)an and an initial 
condition a; 4 0. Evaluate 


M(n) 


< Qan + Gan4+1 +:°+: + Gon 
lim ; 


n—>0o NQan 


(Monthly Problem 11786, 2014). Let x71,x2,... be a sequence of positive 
numbers such that limp... Yn = 0 and 
Ing, 


lim <0. 
n—+00 X41 +Xot+:++2Lly 


Prove that 
Ing, 


im 
n>oo Inn 


For k EN, let d(k) be the largest odd divisor of k. Determine 


. 1 n-k4+1 
a ae pe 
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45. 


46. 


A7. 


48. 


49. 


50. 


51. 


52. 
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Find the limit 


; 1 2 n 


Evaluate 
; 21n24+31n3+---+nlnn 
lim : 
nN—-oCo n2 In n 
Find the limit 
lim ( "W(n+1jl- Vv nl) . 
noo 


(Monthly Problem 11935, 2016). Let f be a function from Zt to Rt such 
that limp. f(n)/n = a, where a > 0. Find 


n+1 n 
dim | “TT £@) — TL t@ 
k=1 k=1 


(Monthly Problem 11771, 2014). Let n!! = []!@> 2/7! (n — 2%). Find 


i=0 
Jim € (2n — 1)! (ton VG a - :)) ; 


(Monthly Problem 11875, 2015). Let f, = (1+1/n)"((2n—1)!!L,)!/". Find 
limpsoo(fn41 — fn). Here n!! = ee (n — 27), where L,, denotes the nth 


Lucas number, given by Lp = 2, 2; = 1, and for other n, by Ly, = Dp_1 + Ln_2. 


(Monthly Problem 12120, 2019). For positive integers n and k with n > k, 
let 


(a) Evaluate 


(b) Evaluate 


where L is the limit in part (a). 
Let a, be a positive sequence such that 
(Qn44 —_ An)(An+1An —, 1) S 0 


for alln EN. If limp+. @n4i/an = 1, prove that a,, converges. 


Let H,, be the nth harmonic number. Define 
Qn = H? - s ay 
n n as k max(k,n—k)- 


Show that limp 5.0 Gn = 77/12. 
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53. 


54. 


59. 


56. 


57. 


58. 


59. 


60. 


61. 


62. 


63. 


Let H,, be the nth harmonic number. Show that 
(a) There is no rational function R(x) such that R(n) = H,, for alln EN. 
(b) H, — H is never an integer for m <n. 
(c) H,, has a non-terminating decimal expansion for n > 7. 
Let H,, be the nth harmonic number. Show that 
(a) Dop-o(-1)**(G) He = = 
(b) Sx=o (i) He =a (Hn a aR) 
n = )eet n 1. 
(c) ei CU (7) Ae = ae 
) 


n (-1)*H 1)"(n+1)Hn-1 , 1-(-1)" 
(d yg @ taf et ? ote. 


Use the Wilf-Zeilberger algorithm to prove that 
n—-1 n- n 
(a) k=1 aCe) (7) = GC ) (Hon—1 — Hn). 
2n n n n— n\ 2 
(b) paar eet i ) (? 7) Cr)# N= (7) : 
Let pp() = An 42%7+4n412—Gn be a sequence of polynomials, where ag = a; = 1 


and Gn42 = Gn41 + Gy for n > 0. Let rp, and s,, be the roots of p,(x) = 0 with 
Tn < Sn. Find limyn_+.5 Tn and limyn_5o6 Sn- 


Let a, be a real sequence and |a| < 1. Prove that if the sequence a,41 + aan 
converges, then a, converges. What happens for |a| > 1? 


Let a, and b, be real sequences with 
bn = Ci An—1 + €2Qn, 


where 0 < cy < cg. Show that b, converges to A if and only if a, converges to 
A/(ci + C2). 
When c; = 1, co = 2, this is Putnam Problem 1969-A6. 


Based on the result in the previous problem, we see that the convergence of a 
sequence is equivalent to the convergence of some its linear combinations. Let 


(a) ap Se ey ae, 
(b) a, = cos? 6 — 3 cos? 30 + +++ + ( 12-12, cos? 38. 


Find the limit of a,, by constructing a new sequence by. 


Let S,, be the sum of lengths of all the sides and all the diagonals of a regular 
n-gon inscribed in a unit circle. Find $, and limy 5. Sn/n?. 


Let 


Find limpn_.oo Sin. 


Let a, be a positive sequence such that Qm4n < Gm@n for all m,n € N. Prove 
that 


‘ lna, : Indy 
lim = inf : 
noo n n>1 n 


Let a, be a nonnegative sequence such that G4 <QmG@n for all m,n € N. Prove 
that sequence ~/a, converges. 
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(Monthly Problem E2860, 1980). Let a, > 0 be a nondecreasing sequence. 
Assume that @m, > ma, for all m,n € N and also sup{a,/n} = 1 < co. Must 
An/n have a limit? 


Assume the sequence a,, satisfies 
Am + An —1< Amin <@m+4n+1, (m,n =1,2,...). 


Prove that limp. Gn/n = a exists and an—1 <a, <an+1 for alln > 1. 


Let a, be an increasing positive sequence with limy+o. an = oo. If the sequence 
Gn+1 — Gy is also increasing, determine 


. LL tat +L 
lim . 


noo 1 ./An 


Let a, be a positive sequence. Prove that 


(a) (Putnam Problem 1949-B5). 


lim sup (= a 7 


an 


(b) (Putnam Problem 1963-A4). 


1+ an 
lim sup n (os - 1) > 1. 


an 


Let x; and 22 be positive numbers. Define, for n > 2 


n 
» 1/n 

En+1 = Tp 
k=1 


Find the limit 


Let 


Prove that x, converges and find its limit. 


Start with a positive triple (a, b,c). Define 


(x0, Yo, 20) = (4,6, ¢), (@n41, Ynt15 Zn41) 
= (Yn + 2n — Bn; Ln + Zn — Ynys En + Yn — 2n) (for n > 0). 


Show that the limits of 2,,y, and zp, exist if and only ifa+b+c=1. Hint. Use 
matrices. 


Start with a n-tuple of real number (21, %2,...,%n). Inductively define 
(k-1) (k-1) 
it a; x; + 2; 
a) = aa. oi*) = a t= 1,2,..., 


where %p)41 = 2. For 1 <i <n, find 


lim al), 
k->00 


Exercises 


72. 


73. 


74. 


79. 


76. 


77. 


78. 


79. 


80. 


(Putnam Problem 1950-A3). Define 


Ln—-1 + (2n— lay 


t= a,r%y = b, In4+1 = On 


(n = 1,2,...) 


Find lim,_..5 Zp concisely in terms of a and b. 


Let f be a monotone decreasing continuous function on (0,-+co) and f(x) > 0. 


Define es 
D1 f 


Prove that a, converges. In particular, if f(a) = 1/2, this limit gives the Euler- 
Mascheroni constant. 


Given xo, x1 > 0, let 
Tn4+1 = Vln* Tn-1; (n = 2,3, end ae 
Find limy_.oo Yn in terms of xp and 7}. 


Let 21 = V5,%n41 = 2 — 2 for all n EN. Evaluate 


£ Ly . v2 ee eee in 
lim 
noo En+1 
Evaluate 
2 n—2 1 


(Monthly Problem 11376, 2008). Given a real number a and a positive integer 
n, let 


s0- Lo az 


an<k<(a+1)n 
For which a does the sequence S;,(a) converge? 
Let f(0) = 0. Assume that f’(0) exists and defines 


nni(a)r()eor) 


Find limp—.55 Gn. Use your result to determine 


. “ k 
nee (i+ 5-1). 


Prove that 
. n_ Vk 
(a) limp soo Die 


(b) limp+o n (Eto = 2) = 


n3/2 
Let 


2 
5° 


Prove that limp, Sn = 1. 
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56 


81. 


82. 


83. 


84. 


85. 


86. 


87. 


88. 


89. 


Sequences 


Let a», be a sequence such that limp—oo (@n 0p, 4%) = 1. Find 


lim V/3n dy. 


noo 
Let a, be a sequence such that e®" + na, = 2 for all n € N. Find 


Jim, n(1 — nan). 


Let do, a1, 42,... be a sequence of nonnegative numbers. The sequence is called 


log-concave (resp. log-convez) if for all k > 1,a,-14%41 < az (resp. Gp_1@n41 > 


rae 


(1) Show that (‘2) is log-concave in k for fixed n. 


(2) If x, is log-concave, show that 


BSE 
=>) (5) es 
j=0 J 


is also log-concave. 


Let a, be a positive sequence and limy_,., dy, = 0. Find 
n 
; 1 k 
SD (oo 5): 


Let a, be a sequence with 1/2 < a, < 1 for all n > 0. Define a sequence b,, by 


Ant+1 -F bn 


bo = ao, Db = —————.. 
0 0, Yn+1 (tae ab. 


Does b, converge? If so, find its limit. 


Let f : [0,1] ++ [0,1] be continuous. Prove that the sequence %n41 = f(Xn) 
converges if and only if 
Jim, ({n41— Ln) = 0. 
Let f : [a,b] + [a,b] such that 
If(z) — FW) < |e — yl (a, y € [a, 8). 
For any 0< a < 1,21 € [a,b], define the sequence 
Ing = OS_ + (loa) fey). 


Prove that z, > x and x = f(z). 


(Putnam Problem 2008-B2). Let Fo(x) = Inz. For n > 0 and x > 0, let 
Fr4i(«) = fy Fr(t) dt. Evaluate 


nF, (1) 


noo §=6oInn 


Let @n41 = In(1—2pn),n =1,2,...,21 € (0,1). Show that 


Exercises 


90. 


91. 


92. 


93. 


94. 


95. 


96. 


Define the sequence x, by 


Lyn +NLy— 
tp = 0, x, = 1, rere oe for n> 1. 
Find limyn_.o5 Ln. 


(Monthly Problem 11559, 2011). For positive p and x € (0,1), define the 
sequence x, by #9 = 1,2, = a, and for n > 1, 


PEn—12n + (1 — parr, 
(1 + p)fn—1 PE 


Tn+1 = 


Find positive real numbers @ and 6 such that limp... n° %n = B. 


Let P(x) = dma™ +--+ +a,” + ao with positive coefficients. Define 


P(1) + P(2) +--+ + P(n) 


Ag= , Gn = YP(1)- P(2)---+ P(n). 


Prove that 


(Monthly Problem 11811, 2014). Let {a,} and {b,,} be infinite sequences of 
positive numbers. Let {2,} be the infinite sequence given by 


a,b, sae Anbn 
by +-:-+bn 


(a) Prove that limy +o. Ln exists. 


(b) Find the set of all c that can occur as that limit, for suitably chosen {a,,} and 


{on}. 


(Monthly Problem 11821, 2015). Let p be a positive integer. Prove that 


Let 


: 1 il 1 1 
hn = =1)"( 4 bees 1 In2), 
d| (145 Tee ee Oe n2) 


where ¥ is the Euler-Mascheroni constant. Find lim,_..5 Rn. 
(Monthly Problem 11973, 2002). Let 


Ry(n) = pas art yarvr 


with k square roots. Prove that limg_,.. Rx (2)/Rg(3) = 3/2. 
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97. 


98. 


99. 


100. 


101. 


102. 


103. 


Sequences 


(Monthly Problem 12129, 2019). Compute 


id ance (ree, 


where the sequence of signs consists of n — 1 plus signs followed by a minus sign 
and repeats with period n. 


(Monthly Problem 11367, 2008). Let x; = /1 42,22 = 1+2V1+3 and 
in general, let 7,41 be the number obtained by replacing the innermost expression 
(1+(n+1)) in the nested square root formula for x, with 1+ (n+1)\/1+ (n+ 2). 


Show that 
: In — Un-1 
lim ——_————— = 
NCO In+1— In 


= fiseyisernyiveravit= 


Show that f(2) = «+1. The particular case x = 2 yields Ramanujan’s formula 


(ee = 


Let F,, be nth Fibonacci number. Define 


dn =| FF? +4| F?4 i b4/e+++4/ FS. 


Prove that limp... Gn = 3. 


Let 


(Putnam problem 1947-A1). If a, is a sequence of numbers such that for 
n>1 
(2— an) a@n4i1 = 1, 
prove that limy so Gn = 1. 
Let ao = 1, and for n €N, define 


An+1 = An + a 
nm 


Find limp+oo A@n/V2n and limp+oo (Gn — V2n). 
(Monthly Problem 12210, 2020). Let x; = 1, and let 


1 2 
er -( wi =) 


when n > 1. For n EN, let a, = 2n + (1/2) logn — x. Show that the sequence 
a1, @2,... converges. 
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104. (Putnam problem 2006-B6). Let & be an integer greater than 1. Suppose 
ago > 0, and 


An41 = An + We 
nr 


for n > 1. Evaluate lim,,., akt!/n*. 
105. Let a; be either 1 or —1 fori = 0,1,...,n—1. Prove that, for every n € N, 


sia votes V 24+ +an-1V2 = 2sin [(a0 —— +---4 ae “|. 


106. Let a, > 0 for all n € N. Define 


. Inlna 
Ln = gee a= lim sup yt 


Prove that 


(a) If a < In2, the sequence x, converges. 
(b) If a > 1n2, the sequence x,, diverges. 
(c) If a=In2, the sequence x, may converge or diverge. 


107. Let a, > 0,6, > 0 for all n € N. Define 


ne ee oe An (n EN). 


Prove that x, converges if and only if 


n . b 
Yn = In (=) +o nF) (n € N) 
k=l 
converges. 
108. Let ao = 1,@n41 = exp(— “y_» ax) for n > 0. Show that 


109. (Monthly 11153, 2005). Let x; = 1, and for n > 1 let p41 = 2, +24 1/2n. 
Define 


1 
Yn = In + 5 Inn— Zp. 


Show that the sequence {y,,} is eventually increasing. 
110. Let p,q € N and p > q. Define 


Sp q(z,n) = S- a* In ee) 
k=0 ah 


Show that 
(a) If |a| < 1, then 


60 


111. 


112. 


113. 


114. 


115. 


116. 


Sequences 


(b) If |z|] > 1 and p =q, then 


ia Span) _ pe 
n—+00 Inn (1-2)? 
(c) If |r| > 1 and p> q, then 
i. Dee ee) 
dim py «(Pp —alng— (p—a) np — 4g). 


(Monthly Problem 11851, 2015). For real a and b > 0 and integer n > 1, let 


1 


n(a, b) = —In(n +a) pe Eee 


(a) Prove that (a, 6) = limn+oo Yn(a, b) exists and is finite. 


(b) Find 
e is 1 a 
li i | . 
ae (» (=) ares: va) 


(Monthly Problem 11852, 2015). For n €N, let v, = k if 3* divides n but 
3*+1 does not. Let x1 = 2, and for n > 2 let 


Ln = 4Un + 2—- 
Tn-1 


Show that every positive rational number appears exactly once in the sequence 

{@n}n>1- 

(Monthly Problem 11976, 2017). Given a positive real number s, consider 

the sequence {u,,} defined by uy = 1, ug = s, and Unde = UnUny1/n for n> 1. 

(a) Show that there is a constant C such that limp. Un = 0o when s > C and 
limn—sco Un = 0 when s < C. 


(b) Calculate lim, +55 Un when s = C. 


(Monthly Problem 11995, 2017). Suppose 0 < 2 < 7, and for n > 1 define 
1 n—1 
Ly =~ S- sin rp. 
k=0 


Find lim,-..5 £,VInn. 


(Math. Magazine Problem 2087, 2020). Consider the sequence defined by 
xz; =a>0and 


vy =in(1 | nha tne for n > 2. 
n—-1 
compute limy soo Ln Inn. 
(Monthly Problem 12166, 2020). Let ap = 0, and define a, recursively by 
ap = e%-1—! for k > 1. 
(a)Prove k/(k +2) < ay <k/(k+1) for k > 1. 
(b)Is there a number c such that ay < (k+c)/(k +¢+ 2) for all k? 


Hint: For part (b), use the Stolz-Cesaro theorem to find an asymptotic expansion 
of Ak. 
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Infinite Numerical Series 


The infinite we shall do right away. The finite may take a little longer. 
— Stanislaw Ulam 


How can intuition deceive us at this point? 
— Henri Poincare 


Equipped with a working knowledge of sequences, in this chapter, we study the con- 
vergence of infinite numerical series. Our focus is on various convergence tests far beyond 
those encountered in a first-year calculus sequence. We provide examples and discuss the 
motivations of the ideas frequently before a new test is introduced. We also explore the 
behavior of a convergent series after rearrangements and prove the famous Riemann series 
theorem. This chapter concludes with some intriguing problems. 


2.1 Main Definitions and Basic Convergence Tests 


“What’s one and one and one and one and one and one and one and one and one and 
one?” 

“I don’t know,” said Alice, “I lost count.” 

“She can’t do Addition,” the Red Queen interrupted. — Lewis Carroll 


Infinite series have intrigued mathematicians since antiquity. The question of how an 
infinite sum of positive terms can yield a finite result was viewed both as a deep philosophical 
challenge and an important gap in the understanding of infinity. Since it is impossible to 
add up infinitely many terms directly, the time has arrived for a precise definition of what 
we mean by the sum of an infinite series. 


Definition 2.1. Given a sequence ay, an infinite series is an expression in the form 


co 
S0 ag = a1 +aQ ++ +On +o 
k=1 


In particular, a, is called the nth term of the series. 
Let 


n 
Sn = D> ay = 0, +02 ++++ +a, (2.1) 
k=1 
which is called the nth partial sum of the series. As n increases, the partial sum includes 
more and more terms of the series. Thus, it is reasonable to view the limit of the sequence 
Sy, as the sum of the series. This leads to 
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Definition 2.2. If the sequence 8, defined by (2.1) converges to s, we say that the series 
yo Gr converges and write 

Co 

Seed 

n=1 


The number s is called the sum of the series. If the sequence Sp, diverges, we say the series 
diverges. In this case, a divergent series has no sum. 


Notice that here the sum of the series is the limit of a sequence of finite sums, instead of 
adding the successive terms together. By considering the sequence of partial sums, we reduce 
the series to a more tractable object—a sequence. Moreover, the theorems on sequences can 
be stated in terms of series. For example, the Cauchy criterion can be restated as: 


Theorem 2.1 (Cauchy Criterion). The series converges if and only if for every « > 0 
there is an N EN such that 


m 
do a 
k=n 


In particular, taking m = n yields 


<eée  wheneverm>n>WN. 


Theorem 2.2 (Necessary Condition for Convergence). If \>7-., ax converges, then 
limpnsoo Gn = 0. 


Given a positive series (i.e., dn > 0 for all n € N), clearly, the s, defined by (2.1) is an 
increasing sequence. Thus, by the monotone convergence theorem, we find that 


Sn converges <> S$, is bounded. 


Thus, to test the convergence of a positive series, it suffices to check the boundedness of the 
series. This observation leads to a powerful technique. 


Theorem 2.3 (Comparison Test). Leta, and b,, be both positive sequences with an < by 
for alln EN. 


1. If y>~, bn converges, then S>-_, an converges. 
2. If Sy, Gn diverges, then Sy, bn diverges. 


Based on the Cauchy criterion, the behavior of a series is determined only by its tails. 
Thus, in the comparison test, the requirement that a, < 6b, does not really need to hold 
for alln € N but just needs to be eventually true, i.e., an <b, holds for all n greater than 
some integer NV. 

When the ratio between consecutive terms is simpler than the terms themselves, which 
is especially true when the terms are in product form, the following test is often more 
convenient to apply. 


Theorem 2.4 (Ratio Comparison Test). Let a, and by, be both positive sequences with 
an41/An < bn41/bn for alln EN. 


1. If S07, bn converges, then S~_, an converges. 
2. If Sy, Gn diverges, then \>~_, by, diverges. 
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Its justification rests on the comparison test. Indeed, by multiplying the inequalities 
aj41/a; < b:41/b; from 1 = 1 toi = n—1, we obtain 


“1b, (n= 1,2,3,-"°)- 


or On SF 
1 


a, by 
Since the series 77", Gi bn and S77", by have the same behavior, the theorem follows 
directly from the comparison test. 

In these two comparison tests, the convergence or divergence of one series is based on 
another series whose convergence or divergence is known. To choose the right series with 
which to compare, we often need some standard series that serve as measuring sticks. The 
three most popular standards are the geometric series, p-series and )\~_, 1/(nlnn). 


Example 2.1 (Geometric Series). A series of the form 
CO 

a+ar+ar?+---= 5° ar” 
n=0 


is called a geometric series. Forr £1, the n partial sum is given by 


J—r 
sy satan fe tart? = Sb) 
—— 


Thus, it follows that the geometric series converges if and only if |r| <1. In particular, for 
In| <1, 

a 
l-r 


atartar?+---= $0 ar? = (2.2) 
n=0 


Example 2.2 (p-series). A series in the form of )>~_, 1/n? is called a p-series, where p 
is a real constant. 


1. Ifp>1, the series converges. 
2. If p <1, the series diverges. 


To this end, if p > 1, let s, be the nth partial sum. For every positive integer n, we have 


a> pl aed Pa Dat 1 
i a Te " (Qn)P 3p | 5p (n+ 1)P 

e453 1 1 i: 1 1 1 1 

' \ op " 4p (2n)P Qp ' Ap (2n)P 

1 
= 14 pl Syn <14 pai 22n+1: 
Hence, 
1 
Sy < San41 < T— 1/2e-1” 


from which the convergence of p-series follows by the monotone convergence theorem. One 
alternative proof is to apply the mean value theorem to f(a) = 1/x?~! on [n — 1,n], which 


gives that 
1 1 p-1l 
(a= 1pP=t — Poi = in 6 (0<6< 1). 


Thus, for n > 2, 
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But the series )>>~_, (1/(n—1)?~!—1/n?—') converges because its partial sums converge, so 
the original series )>>-_, 1/n? converges by the comparison test. In the case where p < 1, for 
each n € N,1/n? > 1/n. Since the harmonic series diverges, it follows from the comparison 
test again that the p-series also diverges. 


Example 2.3. The series ~~, 1/(nlnn) is divergent. 
In fact, applying the mean value theorem to In(Inz) on [n,n + 1] yields 


1 


Inno) an (lin) = ona a) 


, (0<0<1). 


Thus 
1 1 


nian ~ (n + @) In(n + A) =a 


But the nth partial sum of )>°~_, (In(In(n + 1)) — In(Inn)) gives 
In(In(n + 1)) — In(In 2), 


which is divergent. By the comparison test, the series diverges as claimed. 

Now, using the convergent geometric series and the divergent series )>~, 1 as the 
measuring sticks, the ratio comparison test yields two simple and powerful tests that are 
closely related. Both tests work exclusively with the terms of the given series—they require 
neither an initial guess about convergence nor the discovery of a series for comparison. 


Theorem 2.5 (The Ratio Test). Let S>~., an be a positive series and define 


r= lim +, (2.3) 


n+0o An 


1. Ifr <1, the series converges. 
2. Ifr > 1, the series diverges. 


&. Ifr =1, the test is inconclusive. 
Theorem 2.6 (The Root Test). Let >>, an be a positive series and define 
p=lim Yan. (2.4) 
1. Ifp <1, the series converges. 
2. If p > 1, the series diverges. 
3. If 9p =1, the test is inconclusive. 


Remark. Recall that if the limit in (2.3) exists, then so does the limit in (2.4). Moreover, 
r = p (see Example 1.20). Thus, whenever r exists, the ratio test and root test always give 
the same response. However, when r does not exist, the following example indicates that 
even though both tests are applicable, they may yield different conclusions on convergence 
and divergence. 


Example 2.4. Let a and 6 be distinct positive numbers. Determine the convergence of 


l+atab+a7b+a2b? +---+arbr t+ abr +---. 
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Since 


antl F : An+1 
nt* = min(a,b), limsup —* 
an an 


lim inf = max(a, b) 


and 


p= lim Va, = Vab, 
n—->co 


the ratio test shows that if a,b < 1 the series converges and diverges for a,b > 1. But, the 
root test now yields better results: if ab < 1 the series converges and diverges for ab > 1. 

The root test is often more complicated to apply than the ratio test, but it will give an 
answer in some cases where the ratio test is inconclusive. 


Example 2.5. Let 


= Gijoy 2. when n is even, 
ve 2(1/2)"-D/2, when n is odd. 
Since 1 

lim inf UBT -, lim sup a 2: 

Gn 4 An 

the ratio test is inconclusive. But 
, V2 
Pie Voge Sas 


so the root test implies that the series }>°_, an converges. 
Moreover, for any positive sequence a,, appealing to the fact that 
An+1 


a ons 2g : 7 
ied < liminf 7/a,, < limsup ?/a, < limsup ——, 
An an 


lim inf 


we find that whenever the ratio test shows convergence, the root test does too; whenever 
the root test is inconclusive, so is the ratio test. Therefore, the root test is stronger than 
the ratio test. 

Although all the tests above require the positivity of series, they are often used in 
conjunction with the following theorem to handle general series. 


Theorem 2.7 (Absolute Convergence Test). If the series 3, |an| converges, then 
Sr Gn itself converges as well. 


The converse of this theorem is false. Consider the alternating harmonic series 


1 1 1 1 
L--+2-—-—4---4(-1)"t1— +--- 
2 3 4 oy n 
Taking absolute value term by term yields the harmonic series, which diverges. To prove 
the alternating harmonic series indeed converges, as usual, we consider two partial sums 
$an4+1 and sgn, and find that 


1 1 

$2n4+1 — $2n-1 = oe Deal <0, 
1 1 

$2n — §2(n-1) = ar > 0. 


Moreover, 


1 
1— 5 = $2 < San < Santi < $1 = 1. 
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Thus, 52n+41 is monotone decreasing and bounded below while s2, is monotone increasing 
and bounded above. By the monotone convergence theorem, both s2,41 and s2, converge. 


On the other hand, since 
1 


5 ao 

2n+1 
both even and odd partial sums converge to same number. Hence the alternating harmonic 
series converges. The above argument can be extended to the following handy and easy-to- 
use test. 


$2n+1 = $2n 


Theorem 2.8 (Alternating Series Test). Let a, be a sequence satisfying 
1. dn > 0 and ay > an41 for alln EN, 
2. dn 70 asn—- oo. 

Then, the alternating series \\~_, (—1)"*1an converges. 


Hardy [53] once gave the following example to emphasize the need for a, to be strictly 
decreasing to zero as part of the hypothesis for the convergence of an alternating series. 


Example 2.6 (Hardy). The alternating series 


1" 
Jar cip 


diverges. 


The divergence of (2.5) can be readily established by rewriting it as 


a P. Sefer i 
2 Jae ip 7 | vin ae 


a d Jn en 


Here, the first series converges, but the second series diverges because 1/(n + (—1)"\/n) > 
1/2n for every n > 2. 

In general, let a, > O and s, be the nth partial sum of the alternating series 
yoo (-1)"*! an. Then 


n=1 
n n 
Son = A, — 42 +++ + A2n-1 — A2n = s a2k—-1 — s A2k- 
k=1 k=1 


To obtain a desired divergent series, we choose a, so that a, — 0 and only one of the series 
pei Gax—1 and S>/_, a2x converges. For examples, 
1 1 1 1 1 1 1 


1 —— pinats 
so GG Gna” 


Definition 2.3. A series >>, an is said to converge conditionally if it converges but does 
not converge absolutely. 


In general, the alternating series test is the most accessible test for conditional conver- 
gence. To recall our progress to date, we have encountered the tests that often appear in a 
first-year calculus sequence. However, there are many simple series for which the tests listed 
above are inconclusive. 
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Example 2.7. Determine the convergence of 
re 
n=1 2vn 


It resembles a geometric series, but the presence of the square root complicates matters. 
Applying the ratio test yields 


z Bie jg a, Gi Ey 
noo Gy m-300 QVEFI noo QVaFI-Vn” 


providing us no information. The root test is similarly inconclusive. We will see in Section 
2.2 that this series is actually convergent. 

Historically, the most interesting series mathematicians and scientists were encounter- 
ing in the early 19th Century all fell into the inconclusive category of the above tests. To 
overcome the principal drawback of these tests, various sophisticated and finer tests were 
developed. For example, Gauss’s test completely sets the convergence for all hypergeometric 
series. Kummer’s test gives characterizations for convergence or divergence of all positive 
series. Cauchy’s condensation theorem provides an approach to study the convergence or 
divergence of a class of series via a rather “thin” subsequence. To demonstrate the pro- 
gression of these sophisticated and finer tests, we introduce in Section 2.2 the Raabe and 
Logarithmic tests that use p-series as measuring sticks. In Section 2.3, we present the Kum- 
mer and Gauss tests by comparing with the standard series }*1/(nIn? n). For series with 
monotonically decreasing terms, we formulate in Section 2.4 a few simple and interesting 
tests based on Cauchy’s condensation theorem. In Section 2.5, we show that no single test 
can determine convergence or divergence for all positive series. Abel’s test and Dirichlet’s 
test, Riemann series theorem, and Euler’s infinite prime product are the subjects of the 
three subsequent sections. In closing we present some interesting applications of these tests. 


2.2. Raabe and Logarithmic Tests 
The purpose of proof is to understand, not to verify. — Arnold Ross 


We begin with the p-series and see what we can learn from a@y;41/an. Since 


' e i * 1 
Ant. _ n ae ee So 46 =, 
Qn n+i1 n n n? 
a 1 
n(1-S#) =p+o(2). 
An n 


Keeping this in mind, for any positive series, we define Raabe’s sequence by 


Ra =n (1 E st) (2.6) 


An 


it follows that 


For all sufficiently large n, if Ry, > r > 1, equivalently, 


a 1 r 
SO gi 
n 


an 
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Choose a positive number a such that 1+ a<_r. Then, for all sufficiently large n, 
—(1+a) 
1 —(1 1 
(1+) (1-2) == 849) +0(5) >o. 
nm nm nr nr 


—(1+a) 1 

n 1 n & 
Gn+1 (1 i =] 2h CUES 
an a nite 


Therefore, 


Since 7°, 1/n'*@ converges, by the ratio comparison test, the series )7>~_, Gn converges. 
On the other hand, if R,, < 1, then 


An+1 = n—-1 


An n 


By the ratio comparison test again, the divergence of the harmonic series implies that 
or, Gn diverges. 
To summarize, we have established the following test, which is due to Raabe. 


Theorem 2.9 (Raabe’s Test). Let >, a, be a positive series. Suppose that Ry, is 
defined by (2.6). 


1. IfRyn >r>1, the series converges. 
2. If Rn <1, the series divergence. 


In many cases, 2, approaches a limit as n > co. In this case, there is a simple form of 
Raabe’s test. 


Theorem 2.10 (Limit Raabe’s Test). Let \>>-_, an be a positive series. Define 
R= lim Ry, (finite or infinite). 
n—->oco 


1. IfR > 1, the series converges. 
2. IfR <1, the series diverges. 
&. IfR=1, the test is inconclusive. 


Clearly, whenever the ratio test shows convergence, Raabe’s test does too. The following 
two examples show that Raabe’s test is stronger than the ratio test. 


Example 2.8. The series in Example 2.7 indeed converges. 


We have already seen that the ratio test is inconclusive for this series. But, by the mean 
value theorem, 


avn 
Rn =n (: m_ (gvntl _ 9vn) 


gvntl | 9VvnFi 

_ _ _5vnt0 1 

=e Bee mer (0<@<1) 
gvn+8 


n 
2Wn+ Avnet 


Raabe’s test yields the convergence as claimed. 
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Example 2.9. Determine the convergence of 


eae 


n=1 


Again, the ratio test is not delicate enough for this series because 


7 1 iy? 
ne (1 ) > 1. 
an e€ mr 


On the other hand, 


To find limyn+0 Rn, we replace R,, by a more general expression: 


: (1 ute") (x — 0+). 


x e€ 


By L’H6pital’s rule, the ratio of the derivatives, after some simplification, is 


(1+1/a)* In(L+2) — Te 


e€ fied 


Since 


1 
In(l+a)=a- st + o(z”), i — =x-—2"+0(2”), 
where a, = o(b,) means that limp. dn/bn = 0, we find that the desired limit is 1/2. 
Therefore, the proposed series diverges by the limit Raabe’s test. 


Rewriting (2.6) as 
a Rn 
An n 


lim (=) = lim (:-*) =eR 
NCO an n—- Co n 


as long as R = limy_... Ry exists. This observation provides a simple test which is equiv- 
alent to the limit Raabe’s test. 


We find that 


Theorem 2.11. Let >>, an be a positive series, and define 


R* = lim (+) , (finite or infinite). 


n—>0o An, 


1. If R* < 1/e, the series converges. 
2. If R* > 1/e, the series diverges. 
3. If R* =1/e, the test is inconclusive. 


Returning now to Example 2.7, we see that 


This gives an easy proof of the convergence of the series. 
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Moreover, as with Raabe’s test, if In(1/a,)/Inn >1 > 1, we seek a “buffer” between 1 
and J and so choose a real number a > 0 such that |] > 1+ a. Then 


In(1/an) 


>l+a. 
Inn 


This is equivalent to a, < 1/n'*®%, so S07, Gn converges. On the other hand, if 
In(1/an)/Inn < 1, O°, an diverges by comparison with the harmonic series. Putting 
all this together, we obtain a less known convergence test from Cauchy’s arsenal. 


Theorem 2.12 (Logarithmic Test). Let )~ dy be a positive series. Define 


n—->co 


2. In(1/an) 


Inn 


Le (2.7) 


1. If Ly, >> 1, the series converges. 
2. If Ly <1, the series diverges. 


Applying the logarithmic test yields the convergence of the series in Example 2.7 in one 
line. As we will see in the following example, sometimes the logarithmic test turns out to 
be more convenient than Raabe’s test. 


Example 2.10. Let p > 1. Determine the convergence of 


Inn 
nP 
n=1 
Notice that 
In(1/a,) — pInn—In(Inn) _ In(Inn) 
Inn Inn a Inn — 
Since ini 
lim aia) =0, 
n>coo «Inn 
In(1/an) 


there is an integer N such that n > N implies that ~4™ > 1 > 1. Thus, the series 
converges by the logarithmic test. 

In the comparison of the ratio test and the root test, we have seen that if r exists, then 
p exists and r = p. Using the Stolz-Cesaro theorem, we prove a similar relationship between 
Raabe’s test and the logarithmic test. 


Theorem 2.13. Let a, be a positive sequence. Suppose that Ry and Ly are given by (2.6) 
and (2.7), respectively . If limp. Rn exists, finite or infinite, then limp+.. Ln exists and 


lim Ry, = lim Ly. 


n—->co n—->oco 


Proof. Notice that 


- Intl fan) la a). 
a In(nt+1)-Inn on [enleas4/ en): 


By the Stolz-Cesaro theorem, if lim, ... [— 2 In(an41/an)] = 1, then 


fx In(1/an) 


n—-0o Inn 


=I, 
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First, if we assume that limn_... Rr» is finite, then 


(dn41/an — 1) = 0. 


lim 
noo 


Since, for -l <a <1, 


In(1 — 2) = —a ae + o(a”), 
we have 
nl (=) nin [1 (1 “ot ) 
An Qn 
a 1 a - 
=n (1 nt) n (1 nt) + o((1 — Gni1/Gn)?). 
An 2 An 
Hence 


n—- co noo Inn 


lim [=n (=) = lim R, = lim In /an) 


Next, if limp... Rn = +00, given M > 0, there is an integer N such that n(1—an41/ay) > 
M for alln > N. Thus, 
In(1 — M/n) > Inan4i — nan 


and so 
M 1 
a 1+ 3 (M/n) < In(1/an41) — In(1/an); 
M In(1/an41) — In(1/an) 
M , 
i nIn(1 4+ 1/n) In(n+1)—Inn 
Therefore, 
a In(1/a@n41) — In(1/ay) arene In(1/an) 
n—00 In(n+1)—Inn n>co = Inn 
Finally, the case of limp. Rn = —oo parallels the case of +oo. 


When limy+o Rn does not exist, we have 


In(1/an) 


lim inf n(1 — an41/a,) < lim inf = < lim sup < limsup n(1 — an41/Gn). 
n 


In(1/an) 
Inn 
The following example indicates that the logarithmic test is stronger than Raabe’s test. 


Example 2.11. Determine the convergence of 


Co 


1 
oP enrivt 


n=1 


one In(1 1)" +1 In3 
km MO@/an) _ 4, (1 + Inn in 


noo Inn n—00 Inn 


=In3>1, 


the series converges by the logarithmic test. But Raabe’s test is inconclusive since 


An41 { 3-24In(n/n+1) when n is odd; 


An, Ser etl) when n is even 


and 
lim inf n(1 — @n41/an) = — 00, limsupn(1 — an4i/an) = +00. 
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ST 
2.3 The Kummer, Bertrand, and Gauss Tests 
Problems worthy of attack prove their worth by hitting back. — Piet Hein 


Both the limit Raabe’s test and the logarithmic test become inconclusive when R = £ = 
1. To cope with this case, we introduce the following more general test due to Kummer. 
This test comes essentially from telescoping. 


Theorem 2.14 (Kummer’s Test). Let 3>>-_, Gn be a positive series. 
1. 07, dn converges if there is a positive sequence cy, and some constant k > 0 


such that 


An+1 


Ky i= Cn — Cn+1 = k. 


nm 
2. 3, Gn diverges if there is a positive sequence cy, such that SY, 1/c, di- 
verges and Ky, < 0. 
Proof. (1) If 


An+1 


Kn =n - Cn41 2k > 0, 
nm 
multiplying this inequality by a,, yields 
CnQn — Cn41dn41 > kay > 0. (2.8) 


This implies that c,a, is monotone decreasing and bounded below by 0. By the monotone 
convergence theorem, limp. Cndn exists. On the other hand, telescoping gives 


foe) 
So (Gan — Cn414n41) = C11 — lim Cyan. (2.9) 
Pel noo 


By (2.8) and (2.9), the comparison test yields that \°°°_, an converges. 
The convergence of }>>°_, a, can also be proved by showing that the nth partial sum is 


bounded: 


ap S 


w 

3 

T 
M: 


So (crear —Cr4idp+1) (use (2.8)) 
k=l 


k=1 
1 n n+1 

= - Chap — S- Chak (use k + 1 > k in the second sum) 

k=1 k=2 

1 ca 

=e (C1@1 — Cn414n41) < aa 

(2) If 
oa a An+1 Gnas < 0, 
then 


Qn+1 > 1/Cn41 ; 
Qn  1/cr 
The divergence of }°°°_, a, now follows from the ratio comparison test (Theorem 2.4) and 
. lee) . 
the assumption that )77~, 1/cn diverges. 
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In limit version, Kummer’s test can be restated as 


Theorem 2.15 (Limit Kummer’s Test). Let >>, a, be a positive series. For a positive 


SEQUENCE Cy, define 
a An+1 
K= lim (cy - rere Ie 


noo An 


1. If > 0, then the series converges. 
2. If <0 and ~~, 1/cn diverges, then the series diverges. 
&. If =0, the test is inconclusive. 
In contrast to all tests we have studied, Kummer’s test does not merely give very powerful 


sufficient conditions for convergence or divergence of a positive series. Surprisingly, the 
conditions (1) and (2) in the test are indeed necessary. This fact is not well publicized. 


Theorem 2.16. Let ~~~, an be a positive series. 


1. If the series converges, then there exists a positive sequence Cy, for which cy — 
ont 
Cn+1 2 1. 


2. if the series diverges, then there exists a positive sequence Cy for which 
yr, 1/en diverges and cp, — 


Proof. Suppose that S°*., an converges to a real number S. We construct a positive 
sequence c,, for which satisfies the claimed property. To this end, let 


S S-— 
a= > on = Dat 1s (n Pa 2). 
ay an 


Clearly, cy, > 0 for all n € N and 


n 
An+1 Se aa 1%  S—dipe OR ae OE os 


Cn Cn4+1 = 
an an an an 


On the other hand, suppose that }>*-, a, diverges. Let c1,¢n = oper , OR) dala = 2). 
We find that c, > 0 for all n € N and 


Cn — Cn+1 


n 
An+41 EL 1% — Lika1 Uk _ An <0 
an an an an 


Now we prove that )>°°_, 1/cn diverges. We show that for any given positive integer m, 
there is an n > m such that 77_,,, 1/cn > 1/2. To this end, since }>>°_, a, diverges and 
ay > 0, for any given positive integer m, there exists an n > m such that 


Am + Am+1 +++ + an > 41 +42 ++++ + Am-1- 


Hence 


n 


S> Ven = aoe ota an 
ee eee ee a1 +ag+++++4n-1 


k=m 
Om +++: +4n 1 
Gytes-+an 1+ (art +++ am_1)/(an +--+ a4) 
>1/(l+1)=-= 


By the Cauchy’s criterion, )>>°_, 1/cn diverges. 
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In summary, we see that Kummer’s test gives characterizations for convergence or di- 
vergence of all positive series. The drawback of this test is the choice of c,, which has to 
come from the user, and usually there is no particular motivation. Thus, using Kummer’s 
test is equally as difficult as using the comparison test. However, for a suitable choice of cp, 


Kummer’s test is a rich source of many other tests. For example 
y ple, 


1. Let cn = 1. Notice that S>7°_, 1 diverges and K,, = 1— “++. Thus, the ratio test 


an ~ 


is now a special case of Kummer’s test. 


2. Let cn =n— 1. Appealing to the divergence of °°, 1/n and 


(v= 1)- Hn =(n—-1)- (1- 2) n= R= 1, 
n 


an 
we see that Kummer’s test implies Raabe’s test. 
Moreover, let cn = nInn. Recall that >>, 1/(nInn) diverges. We rewrite 


An+1 
an 


n-1 
=tnn|n (1-4) - 1] -m (a4 ! ) 
Gy; n—-1 


n-1 
=B, -in(1+—4.) , 


ninn 


Ky = (n— 1) In(n - 1) - 


n—-1 
where 
B, =Inn c (1 — st — 1 =Inn(R, = 1). 
an 
Since 
1 n-1 
lim In (1 + ) =". 
n—0o n—1 


Kummer’s test yields a logarithmic scale test which was developed by Bertrand. 


Theorem 2.17 (Bertrand’s Test). Let B,, be defined by (2.10). Suppose that 


B= lim B,, (finite or infinite). 
noo 


Then the positive series \.~, an 


1. converges if B > 1, and 
2. diverges if B <1. 


Finally, combining the tests above, we have 


Theorem 2.18 (Gauss’s Test). Let }~, an be a positive series. Suppose 


Ant+1 =A], LL as On 
an n nk? 


where 0, is a bounded sequence and k > 1. 


1. If u>1, the series converges. 
2. If uw <1, the series diverges. 


(2.10) 
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Its justification consists of two cases. In the case p #1, Rn = U+On/n*-1 — p, Raabe’s 
test takes care of the claimed results directly. When yp = 1, in view of (2.10), we have 


Now, the divergence case of Bertrand’s test applies. 
Gauss’s test was custom-made to check the convergence of his famous hypergeometric 
SETLES 


SS. a(at1)---(at+n—1)6(84+1)---(6+n-1) 
844 28 , FISH | oft Mat VSG +E +2) , 


(7 +0) 319(7 + (7 +2) is 


where a, 8, and ¥ are real numbers, none of which is a negative integer or 0. Clearly 


"Ly 


dnt _ (atn(Bt+n) _ r+ (a+ B)n+ a6 
dy (L+n)(ytn) WP +(y+1)nty" 


For all large n the terms a, have the same sign, so Gauss’s test is applicable. Since 


1 t t? 1 
=I] } . ; 
1+t/n n 1+t/n n? 
we have 
eM pce y-a-—BPt+1 _ On 
Gn, n © 2? 


where 0, is bounded. Thus, Gauss’s test shows that the series F(a, 3,-y) converges if and 
only ifa+ 6 <y. This result is sharp and never returns an inconclusive answer. 

Since most of the power series encountered in practice are hypergeometric, when both 
ratio and root tests return inconclusive results, Gauss’s test is the next place to turn. When 
a series is not hypergeometric, the following example indicates that Gauss’s test may return 
an inconclusive answer. 


Example 2.12. Consider the convergence of 


Co 


1 
» nilnn 


n=2 


using Gauss’s test. 
To simplify the algebra, we study the ratio a,/a,_1 rather than a,+41/an. Thus, 
a, _ (n—1)In(n—1) 


An—1 nilnn 


a 1) Ind—n™)  In(i—n") 
= n- Inn ninn 

1 
=1]-— +. =), 

n n 
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where i i i 
E(n) = | Py bia 


Inn 2ninn 6n2Inn 


Here 6, = nE(n) is not bounded. Therefore, Gauss’s test is not applicable. 


2.4 More Sophisticated Tests Based on Monotonicity 
Still round the corner there may wait a new road or a secret gate. 


— John Ronald Tolkien 


Many series have monotone decreasing terms. For such series, the following striking test 
indicates that a rather “thin” subsequence of a, determines the convergence or divergence 


of SS an. 
Theorem 2.19 (Cauchy’s Condensation Test). If a, > 0 is decreasing, then >> an 


converges if and only if > 2° agn converges. 


Proof. By the assumption, it suffices to prove the boundedness of the partial sums. Let 
tn = D>p—1 2*agx. Notice that 
Sgn — Sgn-1 = Agn-144 free Hf agn. 
e———_—_ -——__—_——<—S 


2--lterms 


Thus, 
OP Gace Bon Soret SO" Gath 


Telescoping gives 


1 
gin S S9n Stp-1 + a1, 


and so these two sequences are either both bounded or both unbounded. This completes 
the proof. 


In the Cauchy’s condensation test, clearly, 2"agn can be replaced by m”a,,» where 
m €N. Indeed, we can do even better with the following generalization. 


Theorem 2.20. Leta, > 0 be decreasing. If there is a strictly increasing sequence 1 <n, < 
ng <--> such that (ng+1 — 2K)/(Me — Ne-1) ts bounded as a function of k, then bee Qn 
converges if and only if 7?) (Nk+1 — Nk)An, converges. 


Proof. Let 
n 
tn >= Ly (Meq1 a Nk )An, 5 
k=1 
n 
Un = a (Nk — Nk-1)An,- 
k=2 
We find that 
Sno = 8ny TF Any+1 + An, 42 + °° + Ang 


IV 


Sn, + (nz — 11) Any, = Sn, + U2 
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and in general 
Sn, > Sn, + Ur: (2.11) 


On the other hand, 


Sno—-1 = Sn,-1 an, t QAn,4+1 fists Anzg-1 


Sn,-1 TT (n nz — 1)Qn,,= Sn, + ty 


IA 


and in general 
Sn,—1 < Sn, + tk—-1- (2.12) 


Thus, if s,, diverges, the inequality (2.12) shows that t, diverges as well. Similarly, the 
inequality (2.11) shows that, if u, diverges, so does s,,. Moreover, since (ng41 — Ne) /(nE — 
Nz—-1) is bounded, we deduce that t, and u, converge or diverge together. Thus, all three 
series converge or diverge simultaneously. 


Cauchy’s condensation test is good enough to settle the question of convergence of 
Example 2.12 that Gauss’s test could not handle. In this case, Cauchy’s condensation test 
yields 


ey i eo 
1+ 20 rine tgp 


Since the harmonic series diverges, the series }>>°_. —— also diverges. In Example 2.7, let 
np = k?. Notice that (ng41 — ng) /(Mk — Ne-1) = (2k + 1)/(2k — 1) < 3. Thus, the original 
series converges if and only if 


~ SS. 2k+1 
S>( Nk — Nk)On, = S- 3k (2.13) 
k=1 k=1 


converges. Now applying the ratio test to (2.13) yields that r = 1/2 < 1 and so the original 
series converges. 


The following test is another application of the ratio test along with Cauchy’s conden- 
sation test. 


Theorem 2.21. Let a, > 0 be decreasing and p = limpn-+oo A2n/Gn. Then the series )> an 


1. converges if p < 1/2, 
2. diverges if p > 1/2, 


3. is inconclusive if p = 1/2. 


Proof. If p< 1/2, then 


lim =2p<1 
N00 An 
If n = 2", then 
gk+1 
lim eee 2 2p<1 


By the ratio test, the series 77°, 2" ay. converges. It follows that the original series )* a, 
converges from the Cauchy’s condensation test. 

Along the same lines, we can prove that 5> a, diverges if p > 1/2. For each of the series 
S22, 1/n and 37°, 1/(nIn? n), we have p = 1/2. But the first series diverges while the 
second converges, so it is inconclusive for p = 1/2. 
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The series in Example 2.7 is handled very efficiently by this test. Moreover, notice that 
if limp soo An41/Qn = 17 <1, then there is an integer N and an € > 0 such that 


AQn41 <(r+€)a, whenever n> N. 


Thus, dan < (r+ €)dan_1 < +++ < (r +6)" Gy and so 
a2n 


lim —=0. 
N00 An 


Similarly, if limp+oo @n41/@n = 17 > 1, then 
lim Be +oo. 


N00 An 


Therefore, whenever the ratio test shows convergence or divergence, this new ratio test will 
always give the same response. On the other hand, if limp. @an/a@n = 1/2, then either 
limp+oo Gn41/An does not exists or limps Gn41/dn = 1. Thus, whenever the new test is 
inconclusive, so is the ratio test. These facts indicate that the new test is actually stronger 
than the ratio test. The following example illustrates the power of the new test. 


Example 2.13. Study the convergence of 


n=1 
Clearly, a, = Inn/n? is decreasing for p > 0. Appealing to 
G2n In2n nn? ii In2n , 1 
Gd, (2n)P Inn 2? Inn QP? 


by Theorem 2.21, we find that 


1. Ifp>1, then p= + < 1/2, and so the series converges. 

2. Ifp <1, then p= 35 > 1/2, and so the series diverges. 
When p = 1, the test is inconclusive because p = 1/2. However, in this case, a, = Inn/n > 
1/n for n > 3; by the comparison theorem, the divergence of the harmonic series implies 
that the original series diverges. 

In closing we study one more test due to Cauchy. In contrast to all the tests above, this 
test is based on a comparison between series and improper integrals. 


Theorem 2.22 (Integral Test). Let f(a) be a positive, decreasing and integrable function 
on [1,00). The series S°°°_, f(n) converges if and only if the improper integral 


a f(a) de 


The justification is based on the self evident inequalities 


converges. 


N+1 


N+1 N 
Ss (n) < if f(x) dx < S> f(r), 


in which the partial sums are the right and left Riemann sums of f(a), respectively. 

With this test we have a decided advantage over the previous tests. The other tests, 
powerful as they are, require the user to pick another series that stands in some relationship 
to the given series. But, this test is intrinsic to the series. Most of time, we have only one 
obvious choice for the function. For example, the p-series and }>>~_, 1/(nIn” n) are handled 
very efficiently by this test. 
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2.5 On the Universal Test 


If something cannot go on forever, it will stop. — Herbert Stein 


In the previous three sections, we have displayed a collection of tests far beyond those 
in a first-year calculus sequence. Each test is slightly more complicated than the traditional 
one but handles a few more series, and gives a slightly sharper distinction. Thus, it is natural 
to ask whether there is a universal test which will resolve the convergence or divergence 
for all positive series. Unfortunately, no such test exists. In other words, whatever test is 
considered, one can construct a series for which the test is inconclusive. To see this more 
precisely, we need a few definitions to clarify what is going on. 


Definition 2.4. Consider two positive series 


Co Co 
y An, and y ay, 
n=1 n=1 


1. Suppose both series converge. Let 


Co Co 
) a;, and Rt = ) a; 


i=n+1 i=n+1 


We say that )°~°_, a* converges more slowly than \~~_, Gn if 


= 0. 


2. Suppose both series diverge. Let 


n n 
Sn = ) aj, and s\ = y a;. 
i=1 i=1 


We say that ~~~, a* diverges more slowly than \y_, Gn if 


* 


lm —=0. 
NCO Sy 


Observe that 


1. If 07°, an converges, we can construct a new convergent series as 
[oe) cay 
~ 
4 a, il (\/Rn— 1 Rn), 
n=1 n=1 
where Ro = 0, dn, RY = VRy. Moreover, 


An oS 
aa ee 
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2. If ee _1 Gn diverges, we can construct a new divergent series 


Sat Safar # an = ea 


where s* = ,/S;,. Moreover, 


an Sn — 


ah Vin Va 


= V8n + V/8n—1 > +00. 


In general, we have 
Theorem 2.23. Let S~~_, an be a positive series. 


1. If S07, an converges, then there is a monotone sequence by, such that 
limn—sco bn = 00 and the series pear Andy converges. 


2. If ann Gd, diverges, then there is a monotone sequence b, such that 
limpn—+co bn = 0 and the series Seer Anby, diverges. 


With all of this machinery in place, we see that with any convergent (divergent) positive 
series we can associate another convergent (divergent) positive series constructed from the 
first, that converges (diverges) much more slowly. So there is nonexistence of the “slowest” 
convergent (divergent) series. Therefore, for every positive series there exists a comparison 
test which can decide its convergence or divergence (for example, Kummer’s test). However, 
there is no such universal comparison test that can decide the convergence or divergence of 
all positive series. 


2.6 Tests for General Series 


There is no comparison tests for convergence of conditionally convergent series. 
— Godfrey Harold Hardy 


Under the absolute convergence test (Theorem 2.7), all of the preceding tests for positive 
series become tests for absolute convergence of general series. But none of the convergence 
tests that we have examined so far are applicable to a series that is not alternating and 
does not converge absolutely. We now present two tests that are applicable to the general 
series of the form 


SS Anby = a,b; + Ab + a3b3 + Soe, 
n=1 
Both tests are based on the following algebraic manipulation, which is often called the 


Abel’s summation formula. 


Theorem 2.24 (Abel’s Summation Formula). Let a, and bn be arbitrary sequences. 
Suppose that 


n 


Then 
S aby = >» 84 (DK = bp+1) + Snbn. (2.14) 
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Proof. In view of the fact that a, = s, — 5,1, we have 


S- arnb, = 81d, 4 (so $1) be eee (Sn, Sn—1) bn 
k=1 
= (81b1 + Sabo +--+ + Snbn) — (81b2 + $263 +--+ + Sn-1bn) 
= 81(b, — bz) + 82(b2 — b3) + +++ + Sn—-1(bn—1 — bn) + Snbn 
n-1 
= 84,( De _ be41) + Snby. 
k=1 


Thus, if |s,| < Z for all 1 < k <n and by is monotone (increasing or decreasing), then 
(2.14) implies that 


n n-1 
ss apbe| < ys lbp — baal L + |bn| £ 
k=1 k=1 
= L(|b1 — bn| + |bn|) < LE(|b1| + 2|bn)). (2.15) 


In particular, if b} > b2 >--- > by > 0, we have 


pe arbre 


k=1 


= Gb} (2.16) 


As a corollary of the inequality (2.15), we obtain 


Theorem 2.25 (Abel’s Test). Let >, Gn be a convergent series, and let by, be a bounded 
and monotone sequence. Then >>, Gnbn converges. 


Proof. By the assumption that ae at Gy, converges, the Cauchy criterion implies that given 
€ > 0, for any positive integer p, there is an integer N such that 


|Qn41 + Ony2+-++++4n4tp| < € whenever n > N. 


Let |b,| < M. Taking L = « in (2.15) yields 


n+tm m 
) andr = ; An+kon+k < 3Me. 
k=n+1 k=1 


This proves the convergence of )>>-_, nbn as desired. 


If we replace the convergence of )+-_, @» with bounded partial sums, but strengthen 
the condition on the sequence b,, we obtain another test from (2.16) as follows. 


Theorem 2.26 (Dirichlet’s Test). Let S>°_, an be a series with bounded partial sums, 
and let b, be positive, decreasing and limp. by = 0. Then Bean Andy converges. 


Proof. By the assumption that lim, b, = 0, for any given € > 0, there is an integer N 
such that 
|b, | < € whenever n > N. 


Let |s,| << M for all n € N. Then 


lant1 + On42 ++++ + Antpl = |Sntp — $n| < 2M. 
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Applying the inequality (2.16) yields 


n+tm m 
pS andy = a AntKoOntk < 2M bn41 < 2Me. 
k=n+1 k=1 


This proves the convergence of \>>-_, anbn. 


Both Abel’s test and Dirichlet’s test enable us to test a series that is not necessarily 
alternating and does not converge absolutely. 


Example 2.14. Determine the convergence of 
Co Co 
> b, sin(nxz) and s bp cos(nx) 
n=1 n=1 


where by, is positive, decreasing and approaching to zero as n + oo. 


By the trigonometric identities 


ae __ cos(x/2) — cos((n + 1/2)a) 
d_ sin(ke) = 2 sin(2/2) 


“ sin((n + 1/2)a) — sin(#/2) 
D_ cos(ker) = 2 sin(a/2) 


both partial sums are bounded by 


| sin(x/2)| 


for all « 4 2km (k € Z). By Dirichlet’s test, both series converge for x 4 2kn (k € Z). 

It is worth noticing that these two series do not converge absolutely unless S77~_, bn 
converges. We can prove this with an argument similar to that above. First, Dirichlet’s test 
yields that )>>*_, by cos(2nz) converges. Next, since 


lbp sin(na)| > b, sin?(nx), |by cos(na)| > bp cos?(nz), 
and 


by sin?(nz) = bp (1 — cos(2nx)), 


NLR wle 


bn cos*(nz) = bn (1 + cos(2nx)), 


by the comparison theorem, we find that these two series converge absolutely. Hence both 


series )7°°_, b, sin?(nax) and )>°°_, b, cos?(nx) converge, and therefore }>°°_, by, converges. 
In particular, the following series 


“ sin(nz) a sin(nz) Si An. 
Ds Inn ’ »% nn? Dare! 


n=1 n=1 


are all convergent conditionally, where H,, is the nth harmonic number. 

Observe that a bound on the partial sums in Dirichlet’s test is independent of n. The 
bound we found in Example 2.14 satisfies this requirement, but it does depend on x. Choos- 
ing a specific value for x, we obtain an explicit bound that enables us to apply Dirichlet’s 
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wo 


i) 


-10 -5 5 10 


FIGURE 2.1 
The graph of 1/|sin(a/2)|. 


test. However, the graph of this bound as a function of z becomes unbounded as x ap- 
proaches an even multiple of 7 (see Figure 2.1). 


The strange behavior of the bound is directly related to uniform continuity and the 
behavior of the Fourier series. Here we do not need a uniform bound in order to get con- 
vergence, but we do need a uniform bound in order to have the sum of these continuous 
functions to again be continuous. We will explore this topic further in Chapter 6. 


Next, let 
cy", en 


an = ? n * 
Jn Jn + (-1)" 
In view of Example 2.6, Hardy showed that >>, b, diverges even if }>°~_, ce 
and that limp... @y/b, = 1. Thus, the comparison test for general series needs additional 


condition. As an application of Abel’s test, we show that monotonicity of a,,/b, is one of 
such additional conditions. 


converges 


Theorem 2.27 (Comparison Test for General Series). Let \~, an and >>, bn 
satisfy that 


5 an An . 
lim — =c and — is monotone. 
noo by, Dn 


Then 


pees - 
1. if Sop 1 bn converges, then >77~ 1, Gn converges; 


2. if c #0, then both series are either both divergent, both conditionally conver- 
gent, or both absolutely convergent. 


Proof. In view of that a, = b, - # and the assumptions, (1) follows from Abel’s test 
directly. To show (2), we separate into two cases. 
(a) Since 


An 
bn 


= |el #0, 
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by the comparison test on the positive series, it follows that the series }**-, |an| and 
yr, |bn| are either both convergent or both divergent. 

(b) Assume that neither 37°, an nor S>°°, bn converges absolutely. By (1), we see that 
both series converges or diverges simultaneously. 


Finally, using Abel’s summation formula, we establish the following identity: 


Example 2.15. Let 8, = \;_, ax and |x| <1. Then 


Co Co 
) Anz” = (1-2) ) Sy Xt”. 
n=1 n=1 
Proof. By Abel’s summation formula, we have 
n n-1 
y Ant” = s,(2* — a*®*1) + 5,2". 
k=1 k=1 


To establish the expected identity, we must show that s,2” — 0 as n > oo. To this end, 
let |x| <r <1. Then |az|r* < M for some positive number M. Therefore, 


1 1 M 
[qa |= ae (1424-42) jaPP = (tr tee +r)” 


mr 


ies n= M /(|2|\" Mr 
7 Tor 


rm” l-r 


which implies that s,72” > 0 as n > co. 


In particular, setting a,, = 1/n and using that )>>°_, «”/n = —In(1 — 2), we find that 


= In(1 — 
S eee for |a| < 1, 
a 1-2 


which is the generating function of the harmonic numbers. 


2.7 Properties of Convergent Series 


All happy families resemble one another, each unhappy family is unhappy in its own 
way. — Leo Tolstoy 


As we have seen, the main difference between finite sums and infinite series lies in the 
limiting process. The properties of finite sums often fail to extend to infinite series. For 
example, if we were free to associate terms of the following series at will, then we would 
have 


$24 Seek oS a1) ea 0: 
tPhid det a da 1) Sa oer: 
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Here, the associative law fails. However, we can justify that 


T 
4 3.5 #7 


II 
SO os 
— 
| 
WwlrR 
ans 
+ 
a ~N 
Ol eR 
| 
Ne 
7 
+ 


—, 2 2 i 

= Tap) 5.9 Osis - 

= (; 1) (: see 
35 7 #9 
2 2 2 


SAS as eg eda 


In general, let )>>°_, a, be a convergent series. If we regroup consecutive summands without 
changing their order, we get 


ay + +++ + 4n,54n,41 eee Ongs?** »Ong_iti ters tangs t's 


where nz is a monotone subsequence of N. Let s, = a, +---+ay. Then 


(ai +::: Gn, ) on (Qng_it1 $+ + Ong) = ny: 
The existence of lim,_,.. $» implies that limy_,.. Sy, exists and 
lim sp, = lim Sp. 
k- 00 n— Co 
This proves 


Theorem 2.28. The associative law holds for the convergent series. 


Remark. Observe that 


aa a) eer es ie te ee 
oy ie eee ame | 5 6) 1-2 3-4 5-6 


Thus, grouping of terms may convert a divergent series into a convergent series. Equivalently, 
removal of brackets may destroy convergence. However, if the sum of the absolute values of 
the terms in the brackets tends to 0, in particular, if the terms in each bracket are finite and 
have same sign, the convergence of the bracketed series implies the convergence of the series 
obtained by omitting the brackets. Both series converge to the same sum (see Problem 7 
for the proof). We illustrate this case using the following example. 


Example 2.16. Determine the convergence of ~°~_, (—1)!¥"!/n, where |x| is the greatest 
integer function. 


Proof. Notice that 


ppg eee eee eee 
ae Br ARG eS 


n=1 


Grouping same-sign terms together by letting ny = (k + 1)? —1(k = 1,2,---) yields an 
alternating series 
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Let 
1 1 1 


eo ee ee 
Notice that the sum of the first k terms is less than k - z = 1/k and the sum of the rest of 


k +1 terms is less than (& + 1)- 4K = 1/k. We find that 


by = 


ss < bp < : 

k+1 7 *" 
This shows that by > bg41 and bk — 0 as k > oo. The convergence of the above alternating 
series now follows from the alternating series test. Based on Remark of Theorem 2.28, we 
conclude that the original series converges. 


Next, we turn to the commutative property. The following example shows that different 
rearrangements can lead to different sums. It is well-known that 
irae es ee a 


1 bevle ends 2.17 
ae ae ee 7 ero 


We rearrange of the terms where one positive term is followed by two negative terms: 


Tee De the The oe oo 1 1 
3 6 8 5 10° 12 


Py oe a a Gs es ee 
'\3 6 8'\5 10 12 | 


1 
4 

We lee pale al 1 dl. 1 1 
6 


which is different from the original sum. Thus, the commutative law does not hold for infinite 
series. As we will see in the following two theorems, this happens because the convergence 
is conditional. First, we see that for absolutely convergent series, rearranging the terms has 
no impact at all. 


Theorem 2.29. If the series )~~, an converges absolutely, then any rearrangement of 
this series converges to the same limit. 


Proof. Assume S>>~_, an converges absolutely to S. We begin with the simple case where 
all a, > 0. Let S07, b, be a rearrangement of S>>°_, ay and 


ty = by + bg +--+ + dg. 
be the partial sums of the rearranged series. Since 
by = An, 502 =An2,"""* » OK = anys 


we have t;, < S. So 37>, bn converges. Let S77, b, converge to T. Then T < S. Turning 
this argument around, since }>~~_, ap is a rearrangement of )>>~_, bn, along the same lines, 
we find that S < T. Therefore, S = T. i.e., both series converge to the same limit. 
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Next, we consider the case where a/,s are not all positive. As before, we assume that 
yo, bn is a rearrangement of S°°°, an. Since >>, |a,| converges, we know from our 
n=1 7" g n=l "n° n=1 n ges, 


proof of the first part that 7°°_, |b,| converges and so )>~~_, b, converges absolutely. Let 
= lan| + dn — lan| — an 
Pn 5) > An 2 . 


Since 0 < pr < |an|,0 < dr < |an|, the comparison theorem implies that both series 
yr Pn and S>°_, dn converge. Moreover, 


le) le) ee) 
do an = Qe Pn- Dn: 
n=1 n=1 n=1 


A rearrangement of )>>~_, ay causes the rearrangements of )>7~_, pn and >>, dn, but by 
what we have proved in the first part, the sums do not change. Therefore, the rearranged 
series converges to the same limit. 

Bypassing p,, and q,, we present here another proof using an e — N argument. For any 
given € > 0, there is an integer Ni such that 


€ 
ls, — S| < 5 whenever n > Nj. 


On the other hand, since }>°~_, a, converges absolutely, there is an integer N2 such that 


n 
€ 
S- la;| < 3 whenever n > k > No. 
i=k+1 
Let N = max{ Nj, No} and 
A= {a1, d2,.. ., an}. 
Now we want to move far enough out in the series }+7°_, b» so that we have included all 


terms in A. Thus, choose 
M = max{nj,1<i< N}. 


If k > M, then t, — sy consists of a finite set of terms, the absolute values of which appear 
in the tail 77° y,, |ai|. Our selection of N2 earlier then guarantees |t;, — sy| < €/2, so 


\t;, — S| = \t, —sn + sn — S| 
< |t,—sn|+|sn — S| 
< ene 

go 


whenever k > M. 


We have seen that a rearrangement of the conditionally convergent series (2.17) con- 
verges to half of the original sum. Could a different rearrangement converge to yet another 
limit? How many possible values are there? Surprisingly, Riemann found that there is a 
rearrangement of a conditionally convergent series that converges to any number you wish. 


Theorem 2.30 (Riemann Series Theorem). Let }>~_, an converge conditionally. Then 
there exists a rearrangement of this series that either converges to any preassigned real 
number a or diverges to +00. 
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We first see how this can be done with an example. We take the alternating harmonic 
series and rearrange it such that the resulting series converges to In3 instead of In 2. 

Notice that In3 = 1.098612288.... We add 2 consecutive positive terms such that their 
sum is above In3: 


1 
Lipa = BeOS nen 


Then we add one negative term such the sum drops below In3: 


1 1 
1l+<.—-— = = 0.83333.... 
+3 2 


We now put in more positive terms until the sum is just above In3: 


Le + tile saa Al 
14 + - = 1.17619... 
3 2 5 7 


and then add a negative term until the sum is just below In3 again: 


Pd ad ed 
1+ = 0.92619... 
3 2 5 7 4 meette 


and so on. Thus, no matter how far out we go in the series, there are always enough positive 
or negative terms remaining to move the sum back to the other side of In3. Every term will 
eventually be selected. 


iy 0. a, ot, sg ale Ml 
In3=14 += 4 to + t— 4 
82 Ae a GS a AG 
Ty. dy} Hie Gh Oe 2 a oy as 9 ee 
f—=+— 4 t— 4 + + 


8 17 19 21 10 23 25 12 27 29 


In general, if }>°°_, a, converges conditionally, we customarily separate the positive terms 
from the negative ones, preserving their relative order. Let pz, be the kth positive term, gm 
be the absolute value of the mth negative term. Then the series 77°, pe and ~~ _, dm 
both diverge. We prove this assertion by contradiction. If both were convergent, then 


oo oo oo 
de lanl =D) Pet DS am 
n=1 k=1 m=1 


would converge, contrary to assumption. Since 


N K N-K 
an = s Pk S dm) 
n=1 k=1 m=1 


if one series on the right-hand side converges while the other diverges the series )>>-_, an 
would diverge, again contrary to assumption. With this in mind, we are ready to prove the 
Riemann series theorem. 


Proof. First, let a be an arbitrary real number. We determine the associated rearrangement 
as follows: Beginning with the positive terms, we find the smallest k, such that 


Pi t+ pat-::Pr, > G. 


This can be done because er pr diverges. Then we add consecutive negative terms and 
choose the smallest m, such that the sum drops below a: 


Pit p2+-++ Pry — M1 — 92-7 °° — Im, <G. 
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Notice that 


Pi + Po ++°* Pky — M1 — F2 - 7° — Im, 


is a rearrangement of terms of the original series whose sum can be no further from a than 
dm,- This process is then repeated. We now put in more consecutive positive terms such 
that the total partial sum first exceeds a: 


Pits Pky — GM —°°*— Om + Pky ti t+ +s + PR > a 


and then add consecutive negative terms until the total partial sum first falls short of a: 


Pits + Pky — Gt — Amy + Pky ti +++ + Peo — Gm 41 - 7° — Ima < 4. 


Continuing in this manner, we see that every term in +7, ax eventually appears in the 
above rearranged series. Since the original series converges, a, is approaching to zero. For 
given € > 0, there is a finite number of terms with absolute value greater than or equal to 
e. Let tm be the partial sums of the rearranged series. We move along our rearranged series 
until we have included all terms with absolute value greater than or equal to «. We continue 
moving along the series until we come to the next pair of consecutive partial sums that lie 
on opposite sides of a: 
tn <a<tyny1 or ty >a>tyy41. 


We know that all of the terms from here on have absolute value less than €, and som > N 
implies that |t,, — a| < ¢. Thus, the series rearranged by this alternating scheme converges 
to a as claimed. 

Next, we show that there exists a rearrangement of the original series that diverges to 
+oo. To this end, we determine the rearrangement by alternating a group of positive terms 
followed by a single negative term. Appealing to the divergence of }77°., px, we can choose 
my so large that 

DIRS Pe SG A, 


then mz > mz, so large that 


Prt? + Pmy + Pmt H+ Pm — G1 — 2 > 2 


and, generally, mz > mz_1 so large that 


Bere ie Ho ee ek 
Thus, the series 
Pitre + Pmy — G1 + Prati to++ + Pme — 2 + Pmoti +++ 


diverges to +00. Analogously, we can find a rearrangement of the original series that tends 
to —oo. 


The Riemann series theorem demonstrates that summing infinite series is a tricky busi- 
ness. As has been observed before, the study of infinite processes can carry us into deep 
waters. For example, it is interesting to notice that, for the above rearranged partial sums 
that converge to In3, each time only one negative term is used to bring the partial sum 
below In 3. Indeed, that is the generic case for all a > In2 (see Exercise 119). 

There is no general result about the convergence of rearrangements of conditionally 
convergent series. Each one has to be handled separately. In view of the idea underlying the 
proof of the alternating series test (Theorem 2.8), we have the following convergence test 
based on the subsequences of the partial sum. 
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Theorem 2.31. Let limps |an| = 0 and let S, = Soy, ax. If Skn converges to S for 
some k EN, then \>~_, dy also converges to S. 


Proof. For every m € N and m > k, there is n € N such that kn < m < k(n +1). Since 


m 
Sm = nk + S- ai, 


i=kn4+1 
it follows that 
IS — Sim| < |S — Sken| + S> la;| < |S — Skn| + Bmax{Gngsis'++ ,@(%+41)n}- 
i=kn4+1 


By the assumptions, we see that |S — S,,| can be made as small as desired for large enough 
m. This proves that )>>°_, a, converges to S. 


2.8 Infinite Products 
It takes money to make money. — Proverb 
In this section we give a brief introduction to the theory of infinite products. 


Definition 2.5. Given a sequence a,, an infinite product is an expression of the form 
CO 
[] ax Har: a2-s-an- +. (2.18) 
k=1 


In particular, a, is called the nth factor of the product. 
Let ‘ 
P= |] ag (2.19) 
k=1 


which is called the nth partial product. By analogy with the infinite series, it is natural to say 
the product (2.18) converges if the sequence P,, in (2.19) converges. However, this definition 
has a drawback: every product having one zero factor will be convergent regardless of the 
behavior of the remaining factors. To exclude this situation, we define 


Definition 2.6. If the sequence P,, defined by (2.19) converges to P #0, we say that the 
product [[~, a% converges and write 


co 
II An = P. 
n=1 
The number P is called the value of the product. If the sequence P, converges to zero or 


diverges, we say the product diverges. 


The following examples demonstrate how to use the definition to find the values of some 
products. 
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Example 2.17. Determine the convergence of 

~ 1 

II (1 = =) 

n=2 


This product converges because 


1 1 1 
m= (ing) (-g) (a) 
1-3 2-4 3-5 (n-1)-(n+1) 
re = 
TE sei 


1 
2 
Example 2.18. Prove that, for |x| <1, 


(l+a?"")= 


8 


l-ax 


n=1 


Indeed, we have 


I 


(l—a)-P, = (1-a)(1+a)(1+2?)---(L+2?"") 


(1—a2)(1+207)(1+27)---(1¢2?" )=-- 


I 


= (1- a” ")(1 +92") =1-2?", 
so a 
pe 1-2? 
1-2 


The desired result follows from taking limit n — oo. 


Example 2.19. Let 0 £0. Evaluate 
re 
Qn je 
n=1 
Repeatedly using the double-angle formula for the sine in the form sing = 


2sin(@/2) cos(¢/2) yields 


sind = 2cos(@/2) sin(0/2) 
= 2? cos(0/2) cos(0/2) sin(0/27) = --- 
= 2” cos(/2) cos(0/2?) --- cos(0/2") sin(@/2”) 


Thus, by the well-known limit lim;49 sint/t = 1, we obtain 


sin 0 sind = 6/2" sin 0 


~ Qn sin(0/2") 8 sin(@/2") "0 


TL «xs oO _ sind 
fates i ne 


Pr 


and so 
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In particular, letting 6 = 7/2 gives 


2 ro T 
as II cos (==) ; (2.20) 
Recall that 


min ¥a d a ats 
Z 5 an cos 5 = 5 5 COS a. 
(2.2 


0) yield Vieta’s formula 


2 WEE 


This formula and Wallis’s formula 


2 1 3 3 5 2I@w-1 2n+1 
Pe ar ear a Ge a 
were two of the earliest infinite products built in analysis. Apart from being intrinsically 
interesting, both formulas underlie other important developments in both pure and applied 
mathematics. 
Note that a, = P,/P,-1. If P, converges, then a, — 1 as n > oo. For this reason, we 
often write a, = 1+ b,. Since In(1 + b,) ~ bp, it is easy to show 


These identities along with 


(2.21) 


Theorem 2.32. Let b, > 0 for alln € N. Then the product []7_, (1+bn) converges if and 
only if S>7-_, bn converges. 


The following result is analogous to this theorem. 


Theorem 2.33. Let b,, > 0 for alln € N. Then the product [[7~_, (1—bn) converges if and 
only if \>~_, bn converges. 


We conclude this section by presenting Euler’s remarkable identity, which expresses the 
Riemann zeta function ¢(s) = S>°~_, 1/n° as an infinite product extended over all primes. 


Theorem 2.34. Let py, be kth prime number and s > 1. Then 
a 


Proof. Let P, = [[;_, (1 —p,°)7* be the nth partial product. Applying the geometric 
series expansion, for each prime number pz, we have 


(2.22) 


piesa eiffel eas 
Lt) py pe pee 


which converges absolutely, so 
= ae 
=|[ (1+5+—4+:°:}. 
k=1 PrP 


We now multiply these series together and rearrange the terms according to increasing 
denominators. This yields an absolutely convergent series, a typical term of which is 
1 1 


ae where m = p}'ps?--- pr, ri > 0. 
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Therefore, we have 
1 
Pr = > fee 
where the summation on the right-hand side is over those m with prime factors < p,. By the 
unique factorization theorem, each such m occurs exactly once in the sum 5~,. To illustrate, 
we have 


1 1 1 1 1 1 
Pz; = (+c+st) (+p gee) C+se ae) 


9s 928 38 32s 5s 52s 
ee ree ret are oe a eee Oe ae eee Oe eae 
- ' 9s" 38 ' 48 ' 5s ' 68 Bs gs’ 105 | 125 158° 165 ° 188 
1 1 1 1 1 1 1 1 1 1 1 1 
+ + + + 


Thus 1 

C(s) — Pr = ye me’ 
where the sum )~,, is over those m having at least one prime factor > p,. Since these m 
occur among the integers > p,, we have 


()-Pas SS. 


M>Pn 


The convergence of the p-series implies that P,, + ¢(s) as n > oo. 


Based on (2.22), Euler gave two beautiful proofs of the fact that there are infinitely many 
prime numbers. His first proof goes this way. If there were only a finite number of primes, 
then the product on the right hand side of (2.22) would be an ordinary finite product and 
would be well defined for every s > 0, even for s = 1. But, the value on the left-hand side 
for s = 1 is the harmonic series, which diverges to infinity. This contradiction shows that 
there must be infinitely many prime numbers. His second proof rests on 


1 1 Pntl d 
[mee hcef Semon +0, 
n 1 x 


and his discovery that 


diverges. 


2.9 Worked Examples 


Wit lies in recognizing the resemblance among things which differ and the difference 
between things which are alike. — Madame Stael 


In this section, to expose ourselves to a wide variety of strategies for tacking problems, 
we select 25 problems that we find intriguing for one reason or another. They may confirm 
a common intuitive notion with a clarifying proof or may provide a counterexample to 
intuition, while some may present unexpected techniques. 
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1. Let a, > 0 be decreasing for all n € N. If peer Gy, converges, then limp_.55 Nan = 
0. 


Proof. Let sn = Y°,—, @%- By assumption, we have 
NQIn < An+1 + An42 +°°* + Gan = San — Sn- 
The convergence of s,, implies that naz, — 0 as n > oo, and so 
2nd, > 0 as n> oo. (2.23) 
Along the same lines, we have 
(n+ Ldany1 < Gn41 + Gnp2 +++ dan41 = Sen41 — Sn 3 0 


as n — oo. Thus, 2(n + 1)aan41 4 0 as n > 00, so 


(2n + L)dan4i = 2[(n + 1)dan41] — Gdant1 > 0 asn—- oo. (2.24) 


The desired limit now follows from the facts (2.23) and (2.24). 


Remark. Using Abel’s summation formula (2.14), we have 


n n-1 
) a ) k (ap — Gp41) + an. 
k=1 k=1 


If a, > O is decreasing, we find that S°°, a, converges if and only if 
limp+oo Ndn = 0 and S>*, (@n — Gn4i)n converges. Here the assumption of 
monotonicity of a, is necessary. Consider 


1 1 1 1 1 1 1 1 


14 t t t t t t bee) 2.25 

22 3 4 % 52 62 72 82” ( ) 
Clearly, this series is less than 2 )°°°_, 1/n?, which is a convergent p-series. Thus, 
the series (2.25) converges. Notice that na, = 1 for every n = k?, so that 


limp+oo NAn # VO. Moreover, the divergence of Sat 1/(nlnn) indicates that 
the converse of this problem is false. 

2. Let a, be a positive sequence such that limn. dn = 0. Prove that 07°, |1— 
An+1/Gn| diverges. 


Proof. We proceed by contradiction. Let b, = 1 — G@n41/adn, and assume that 
ye [bn| converges. Thus, lim,-,. bn = 0. Without loss of generality, we may 
assume that |b,| < 1/2 for all n ¢ N. Then 

a, ag An 


ay(1 = by) (1 — be) 29 (1 = bn41)- 


Taking the logarithm of both sides yields 


Qn4+1l = a1" 


l| 


Inanyi = Ina; + In(1 — b)) + In(1 — bg) +--+ + In(1 — by41). 


Since limp+oo Gn = 0, it follows that limn+oo Nan = — 00, and so >, In(1 — 
bn) diverges. In view of the fact that 


In(l—2) >—-2|2| for |a| < 1/2, 


the comparison test implies that 5>°°_, |b, | diverges, which contradicts the as- 
sumption that °°, |bn| converges. 
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3. Let 377°, dn be a convergent positive series and set r, = D\7_,, @%. Prove that 
1 Gn/Tn diverges. 


Proof. By the definition, r, is monotone decreasing. Hence, for all n € N, 


a Ae r 
> an; an = eae — 1 
r r r. 
k=n 7 " k=n m 


It follows that }°°°_, Gn/rn diverges from the Cauchy criterion (Theorem 2.1). 


A more careful proof is given as follows. Notice that rz, = dn + 1n+41. We have 


Tn+1 = 1 an Tn+2 = (1 on) (1 on > 1 an An+1 


Tn Tn Tn Tn Tnt+1 Tn Tntl 


By induction, for all n,p € N, we find that 


Trt an An+1 An+ 
P >1 steed P 


Tn Tn Tr+l1 Tr+p 


Since }7*°_, Gn converges, it follows that r,,4, — 0 as p — oo. Thus, for any fixed 
€ € (0,1) and every n €N, there exists a p € N such that 
an An+1 An+p 


- bees 4 >1 
ln Tr+l1 Tr+p Tn 


Tn+p 


> €. 


This implies that 377—_, Gn/rn diverges. 


4. There exists a divergent series such that its partial sums are bounded and 
limnsco An = 0. 


Proof. Define the sequence a, by 


1 titi it 21 1 éii41 


vale ’ 9929? 9? ’ ) ’ tis 
2 2333 4 4 4 4 


Let s, = Sees Gn, be the nth partial sum. Clearly, 0 < s, < 1 and limyn+. adn = 
0. But, since s,, takes on values 0 and 1 infinitely many times as n > oo, 
limy-soo Sn does not exists, so the corresponding series diverges. 


5. Let limy—soo n (san, -1) = a > O. Prove that the alternating Sehike 
, (-1)"~" an converges. 


Proof. We verify the conditions in the alternating series test. First, by the as- 
sumption, there is an integer N, such that 


n( BIE 9 1) > a whenever n > Nj. 


This implies that 
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Therefore, a, is monotonically decreasing for n > N,. Next, let 0 < 8 < a/2. 


Since J 
(1+) 1 =p<f, 
n 2 


it follows that, there is an integer N2 such that 


B 
ib 
(1++) 29 e 
n 2n Qn+1 


lim n 
noo 


and so 
nan > (n+ 1)’ an41 >0 


whenever n > N3. Thus, the sequence n’a,, converges by the monotone conver- 
gence theorem. Therefore, a, — 0 as n > co. In summary, we have proved that, 
for n > max{ Nj, No},a, monotonically decreases to zero. Hence the given series 
converges by the alternating series test. 


Let a, be a decreasing sequence and lim,_,9 a, = 0. Prove that 


Co 


( yr a, +ag+-+++an 
n 
n=1 


converges. 


Proof. Notice that 


a, tage +Gn A +42 477 + On + Gn41 


n n+1 
Ay FAQ Ft + An — NAn+1 
* n(n +1) 
(a1 — Gai) + (G2 — Gag) +++ + (An — Gn41) 
= > 0. 
n(n +1) 


Thus, the general terms of the given series are decreasing. On the other hand, 
the Stolz-Cesaro theorem implies that 
ay + a2+°++ +n 


lim = lim an41 = 0. 
noo n noo 


The desired result then follows from the alternating series test. 


Consider some grouping of the series See dy. Further, suppose that the sum of 
the absolute values of the terms in the groups tends to 0. If the grouping series 
converges, show that the original series converges to the same sum. 


Proof. Let the grouped series be 
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where 0 = np < my < ng... and limg_5.o ny = +o0. For any N EN, there exists 
some Kk € N such that ng < N < nx41. Thus, 


N K Nk N 
=~ a ~ 
dem dol dF anfy=| DL an 
n=1 k=1 n=NnNp—-14+1 n=nKt+1 
N NK41 


IA 
M 
oa 
IA 
M 
P 


n=nKt1 n=nKt+l 
By the assumption, we have 
NK41 
lim y ay| = 0. 
n=nKt1 


Since the grouped series converges, letting N — oo in the estimate above, in this 
case, so does K, we obtain 


foe) N foe) Nk 

y Qn = lim y an = ) ) An 
N- oo 

n=1 n=1 k=1 n=np—-14+1 


8. (Monthly Problem 12101, 2019). Find the least upper bound of 


Ent — Vin 
a V(1+ #n41)(1 + tn) 


over all increasing sequences 271, %2,... of positive real numbers. 


Solution. We show that the desired least upper bound is 7/2. First, we reformulate 
the series by trigonometric substitution. Based on the structure of the summands, 
appealing to the trigonometric identity 


x 
=a). 


arctan x = arcsin ( 


if 0 <a< b, we introduce 


sina = 


lhe 2 vb 
Hee sin = eo 
Then a = arctan \/a, 8 = arctan Vb, and 
vb— Ja 
(1+a)(1+6) 
Since xz, is positive and increasing, the above reformulation implies 


- Vtn+l — / In = : 
S- Ja Feta = ye sin(arctan \/%,41 — arctan \/Z;,) 
n=1 n n n=1 


[oe) 
< y (arctan Jtn+1 — arctan fir) 
n=1 


= sin B cosa — cos 8 sina = sin(3 — a). 


(use sina < a for x > 0) 


= arctan \/sup{z, } — arctan,/xz; (telescoping) 
< — arctan ,/71 < a 


Thus, 7/2 is the upper bound of the series, which is not attained. 
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Next, we construct a positive sequence as follows: For any positive integer N, let 


_ f tan? (24), a =1,2,...,N —1, 
oe tyn-1+n—-N+1, forn>N. 


Clearly, x», is strictly increasing, and 


ae, Jini — Jin si el We 


VAG + Ear al + tr) 


_ 3 _ ((nt+1)r no 
~ 2 ON” aN 


Since 


lim (N - 2)sin(-) =, 
Wee oN) ~ 2 


this proves that 7/2 is the least upper bound. 


9. (Monthly Problem 12084, 2019). Let aj, a2,... be a sequence of nonnegative 
numbers. Prove that (1/n)5>/_, ax is unbounded if and only if there exists a 
decreasing sequence 6y,b2,... such that limn +o bn = Oya b, is finite, and 
yo Gnbn is infinite. Is the word “decreasing” essential? 


Proof. Let An = >>; a. Assume that 4+ 57;'_, ag is unbounded. Then there is 
a strictly increasing sequence n; € N such that A, > kn;. Let no = 1. Define 


“1 
bi = De fori =nj-1+1,...,n; with 7 >1 
k=j 
Clearly the sequence bj, b2,... is decreasing and tends to 0. Moreover, 
co co CO 1 
den = Ding — 15-1) Da 
n=1 j=l k= rink 
“1 “1 wr 
= vw ae 
k=1 j=l k=1 


Thus, )>>~_, bp is finite. By the Abel’s summation formula (2.14), we have 


Sa = Sa —Mn41) > a : = = Ss an 
n=1 n=1 kel nk a4 k 


which shows that °°, @nb,, is infinite. 


Conversely, we assume that 6b, is decreasing such that limp. bn = 0, au n is 
finite, and )°°°_, dnb, is infinite. We proceed by contradiction. If (1 / day ie 
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is bounded, then there is some positive number M such that A, < Mn for all 
n € N. Applying Abel’s summation formula (2.14) again, we have 


n-1 


> Apo, = Se Ax(be — bk41) + Anbn 
hat bet 


n-1 n 


< S$ Mk (by = be41) + Mbp = MS © bg. 
k=1 k=1 


This implies that }7°~_, anbn is finite since }>>~_, by is finite, which contradicting 
our assumption. 


Finally, we show that the word “decreasing” is essential by an example. For n € N, 
let 
1 (—1)” 
Q2n = > : 
Jn Jn 


Then 5>~~_, 6, is finite by the alternating series test, and 


Da anbs = 2, aanbon ae V2 2a, 


is unbounded because the harmonic series diverges. However, (1/n) }<7_1 ax is 
bounded, since 


1 1 1 
pe Se oe «| B-3S? 


a2n-1 = 0; bn = 


10. (Math Magazine Problem 2097, 2020). For a real number x ¢ 1/24 Z, 
denote the nearest integer to x by (x). For any real number 2, denote the largest 
smaller than or equal to x and the smallest integer larger than or equal to x by 
|x| and [x], respectively. For a positive integer n, let 


2 1 1 
(¥m) [vn] [vn] 


(a) Prove that the series )>>°_, a» is convergent and find its sum L. 


(b) Prove that the set 
{ve(3- nt) : ni} 
k=1 


Proof. (a) We show that the sum converges to zero. To see this, first, we can 
easily check the following facts: 


an = 


is dense in [0, 1]. 


(/n) =k, for n € [k(k—1) +1, k(k +4 1)], 
[/n| =k, for n& [k?,(k + 1)?), 
[/n] =k+1, for n € (k?, (k + 1)?]. 
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These imply that a,2 = 0 and 


| ae | 
ik k k+l k(k+1)’ 

2 1 —— 1 
k+l k k+l k(k+1)’ 


for n € (k?, k(k + 1)], 


for n € (k(k +1), (k+1)?). 


an = 


Therefore, for k? <n < (k +1)”, we have as dm = 0 and 


SD om uk ri) EE Ton Wd pea 


m=1 


As n — 00, we have k > co and so 
co n 
) Qn = lim ) Am = 0. 
noo 
n=1 m=1 


(b) Let x € [0,1]. We show that there exists a subsequence from the set 
{/n >>" _1 Gm} that converges to x. Notice that there exist two integer sequences 
pr and gy with 0 < py < q, such that p,/qy > x as k > co. Let ny = qZ + Dp. 
Then 


2 
dk Sm Suto < (m+5) ; 
This implies that 
(Vr) =n, LVrK] =a, [Vr] = oe +1. 
Therefore, as k + oo, we have 


2 
Nk — Up Pr VMk 
k ) Am = Vk: = > Dy 
"e ae(@e +1) Ge Getl 


m=1 


This proves that the set {/n 5+" _, am} is dense in [0, 1]. 


(Monthly Problem 11829, 2015). Let a, be a monotone decreasing sequence 
of real numbers that converges to 0. Prove that }>>°_, a,/n < oo if and only if 
dn = O(1/Inn) and SYP", (an — Qn41) nn < ow. 


Proof. Let 
So S- % i oe (ay — Gp41) Ink. 
k=1 k=1 
In view of the assumption of a,, S, and T,, both are monotone increasing. Let 
their limits are S and T, respectively. 


“=>” Assume that S' is finite. For k > 2, we have 
k 
d. 1 
Ink — In(k — 1) =| ac een 
ae x k = 1 


n n 


am lnn < ay > (Ink —1 Sie 


k=2 k=2 k=2 


Thus, 
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12. 


and so dy, = O(1/Inn). Next, we have 


Lo S- ax lnk — S~ ap4i lnk 

k=1 k=1 

= S- ay(Ink — In(k — 1)) — adniy inn 
k=2 
“ak “ aK—-1 

< < 

a as 
k=2 k=2 

=? Sn—1 < S. 


This implies that T is finite. 
“ <=” Assume that a,Inn < M for some positive constant M and T < oo. 
Since 


S,-a = >- = < S~ ax(Ink — In(k — 1) 


k=2 k=2 
n n-1 
= S- ax Ink — S- Gp4i1 lnk 
k=2 k=2 
n-1 


< T4+M, 


it follows that S is finite as desired. 


A similar problem appears in the 2015 Monthly November issue. Problem 11865 
states that if a, is a decreasing sequence of nonnegative real numbers, then 
yr, an /n is finite if and only if limy_,.o dy = O and 7°", (@n—Gn41) nn < oo. 
In this case, we show that limp. dn = 0, together with T < oo, implies that 
dn lnn < T. Indeed, for m > n> 1, we have 


m m 


(Gn — @m41) nn = S- (ap — p41) Inn < x (ap — Qg41) nk < T. 


k=n k=n 
In view of that limy-+4 an = 0, letting m — oo yields 


aQanlnn<T  foralln>1. 


For n > 2, show that the integer nearest to n!/e is divisible by n — 1 but not by 
n. 


Proof. Since 


it follows that 
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Clearly, the first term in the sum is an integer. The second term is bounded by 


eh 2 =, ite ad 


——| <n! . 
ae (n+1)! n+17 3 


k=n+1 


Therefore, the integer nearest to n!/e is 


Rewrite N as 


n—-2 _4)\k 
N = n(n-1) loa | ayn (" 
k=0 , 
n—2 _4)k 
a. nan fm- reat, 
k=0 


the number inside the bracket is an integer. Hence N is divisible by n — 1. 


13. Let a, > 0 for all n € N. If 0°, a, converges, prove that S77, ain in 


converges as well. 
Proof. Applying the AM-GM inequality yields 


Dan (n —2)ay 


ger Bs (at/? . al? . re < 


Moreover, we have 


1/2 
nm 


1 
—— <a,+-5 (using 2ab < a? + 6?) 
n 
and (n — 2)ay/n < ap. Therefore, 
(n—-1)/n 1 
ay < 2an+ aE 
n 


By the assumption that S>>°_, an converges, and }-*~_, 1/n? converges, the com- 


parison test implies that )°>°_, aft V/ ” converges. 


An alternative solution is based on the following partition: 


N, ={neN : Gn < 1/2"}, No =N\Nj. 


(n—-1)/n 
q@-Dine (1 eet 
n = Qn Qn-1 


If n € N,, we have 
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If n E€ No, 


Therefore, 


So alms Lt TS tan S242 Yt < 00 
n=1 


neN, n€No n=1 


1—bn 


Under the same assumption, this approach can be used to show that 77°, al, 


converges as well provided b, = O(1/Inn). 


14. Let H, be the nth harmonic number, and let n, be the smallest integer n sat- 
isfying H, > p (for example, ny = 1,ng = 4,n3 = 11). Prove that est 1/np 
converges. 

Since H,, grows like Inn, intuitively, we would expect n,, which is in a sense an 
“approximate inverse” to H,,, to grow like e?. We confirm this as follows. 


Proof. By the assumption, we have 


1 
An, — — = Np—1 <p< Fp,. 
p 


Thus, H,, = p—kp, where kp is a nonnegative constant bounded above by 1/np. 
In particular, k, — 0 as p > ov. Recalling that H, =Inn+1/n+ Yn, where yn 
converges to Euler-Mascheroni constant 7, we have 


1 
P= Hn, + kp =Intp + —— + Yn + kp, 
Pp 


and so f 
lim (p—Inn,) = lim (+ +n, + ky) =. 


poo poco \ Np 


Similarly, we also have 


lim (p+ 1—Inn,41) = 7. 


proo 
The difference yields 
lim (1-m“#) =0 
This is equivalent to 
lim veel 
poco Np : 


from which it follows the given series converges by the ratio test. 


15. Does there exist a bijective map 0 : N—-N such that 


E9 


<oo? 
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Solution. We show that the series }\°°_, o(n)/n? diverges for any bijection from 
N to N. To see this, since o is a permutation of N, it follows that 
1 
o(1) +0(2)+---to(n) >14+24+---+n= SS 


Thus, by Abel’s summation formula (2.14), we have 


N N- N 
P= Y oa +-+om ( : ) ta DS on) 


nn? (n+1)? 


SA n(n-1)) Qnt+1 = N41 
2) % oat a 
s (n-1)Qn+1) ,N+1 

n(n+1j? aN 
sys SDs a 
aces Cee) ne 


An alternative proof is based on the Cauchy criterion. Observe that, of {o(N + 
1),a(N 4+ 2),--- ,0(3N)}, only N of them are possibly at most N, the rest of 
them must be strictly greater than N. This yields the estimate 


3N 3N 


a(n) 1 1 1 

y > ) a(n) > —>:-N-N=-. 
2 2 2 

some, Oe (3N) anit 9N 9 


It implies that 377°, o(n)/n? diverges by the Cauchy criterion. 


16. (Monthly Problem 11954, 2017). Determine the largest constant c and the 
smallest constant d such that, for all positive integers n, 


1 Set a 1 


Solution. First, we rewrite the proposed inequality equivalently as 


c<n Sop =n 7 <d_ forallneN. 


Let 


We next show that 


to be strictly increasing on (1,00). Upon showing that F(a) is increasing, an 
immediate consequence is 


a) ec ae 0) 


1 
eee AS 5 
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To prove that F(x) is strictly increasing, we show that F’(”) > 0 for « > 1. 


Indeed, since 

vile) _ vile)+n@) 
viz) Ht(x) 
it suffices to show that #?(r) + (x) > 0 for x > 1. Let 


F'(z) =1+ 


2 / = 7 1 ; ~ 1 
G(z) = vi (2) + ¥{(2) = (>: ma) 2s (a 


Since limz_,0. G(x) = 0, it remains to show that G(a +1) — G(x) <0 for x > 1. 
To this end, using ~(2 + 1) = wi(x) — 1/2, we find 


o@+n-a@)=(vi@)-4) +(vi@+ 3) -#@ - 


Q(z) 1 2 2 4 
2 bs x4 = oe ge (vit) 2 =) 
Let 1 
H(2) = tla) - 2-55 


Then limz-+.. H(x) = 0. Moreover, 


H(e+1)— H(z) = (vue) =) v1 (x) ei one 
1 
“Sails pie 


This implies that G(a + 1) — G(x) < 0 for x > 1, and so F’(x) > 0 for x > 1. 
Therefore, F'(a) is strictly increasing for x > 1. 


Remark. As a byproduct, the above proof actually establishes the inequality 


oS ° oS 1 ° 
S- aap < (>: a) for alla > 1. 


k=0 


The function 7; (a) used in the above proof is often called the trigamma function, 
which is the second of the polygamma functions: 


where w(x) is the digamma function and I(x) is the gamma function (see Chapter 
7). Taking the derivative of the asymptotic expansion of the digamma function, 
we have 
ul 1 1 ul 1 1 
VUE) oye G8 Soar aoa? S0ge 

The Riemann series theorem challenges our conceptions in an interesting way. 
Seeing what can go wrong is often an indispensable way to gain insight and 
intuition into the foundations of analysis. The following problem shows that, for 
a positive divergent series, there exists a subseries that converges to any positive 
number as you wish. The proof is similar to the proof of the Riemann series 
theorem. 
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17. Let a, be a positive sequence such that lim, ... Gdn = 0. If the series a eee Qn 
diverges and a > 0, prove that there is a subseries of )7°°_, a, that converges 
to a. 


Proof. Since limyn+oo Gn = 0, there is the least integer n; such that a, < a/2 for 
all n > n,. Let m, be the greatest integer for which 


81 =4n, + Gn, 41 +++: + am, <a. 


Then a/2 < s; < asince s; < a/2 will against to the selection of m;. Let ng be 
the least integer such that ng > m, and ay < (a — s,)/2 whenever n > no. Let 
mg be the greatest integer for which 


82 = 81 $Any +Ong41 +++ t+ Gms, < a. 


Then a — a/2? < sy <a. Repeating this process yields the sequences nz and mz 
such that 
nym <ng <M. < ng < M3 <°:-, 


Sk = 8k-1 + Gn, + An,41 +°+* + Gm; 


and a — a/2* < s, <a. By the squeeze theorem, the following subseries 


An, +On,+1+:+:+@m, + Ong FAngti t+ +Am,+++++An, FOn,+1+++:+am, +°°° 


converges to a as desired. 


Let a, = 1/n for all n € N. In particular, for each N € N, the harmonic series 
has a subseries that converges to N. On the other hand, let s, = Sy 1/n. It is 
well-known that s; is never an integer for k > 2. However, surprisingly, we have 

18. Prove that every positive rational number is the finite sum of a subseries of the 
harmonic series. 


Proof. Without loss of generality, we assume that p/q > 1. Let ni be uniquely 
determined by 
1 1 op d 1 1 


=I J}... < 1-4 pares persia . 
$1 15 Vg aT eae ier Oy 


Let pi/qi = p/q — 81 and assume that p;/qi > 0. Let ng be uniquely determined 
by no < qm /pi < m2 +1 and set 


P2 Pi 1 
@ nan nati 


Let ng be uniquely determined by n3 < qgo/p2 < ng +1 and set 


P3 _ p2 1 
qg 9g ntl 
and so on. Since py > p2 > p3 > -:-, after finitely many steps we must have 
Pr= 1, that is 
1 Pe _ Pr-1 1 
dk Gk Gk-1 MR+1 
Therefore, 
Pp _ eal 1 | ae eee 1 


q igo, mg 
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19. 


The process above can be done with an example: p/q = 9/5, we have n; = 2,n2 = 
3,n3 = 20, and 
9 1 1 1 
=14 : 
5 2 4 20 
These unit fractions are often called Egyptian fractions. They continue to be an 
object of study in modern number theory and recreational mathematics, as well 


as in modern historical studies of ancient mathematics. 


Suppose a,, and b, are decreasing sequences of positive numbers with limits D 
and M, respectively. Prove that 


xc =f nt OE bee Se Cay De = MD): 


Proof. Telescoping yields 

n 

So (a Gk — Ak41) = 41 —Gn41 > a,—L, (asn—- oo). 

k=1 
So the series )>°°_, (an — Gn41) converges. By the assumption, b, is a mono- 
tone and bounded sequence. Thus, by Abel’s test, both 377°, (an — @n41)bn and 


pS (an oF An+1)0n41 converge. Let 


k 
Sk= S- (a; = Qi+1) = 4) — Ap4i- 
i=l 


Then 0 < s, < a; — L for all k € N. Moreover, in view of Abel’s summation 
formula (2.14), we have 


n n-1 
Ss" (ap — Gp41)d Sk(be — be41) + 8nd 
k=1 k=1 
n-1 
< SU (a1 ~ L) (be — Best) + (a1 — Lybn 
k=1 
= (a1 — L)by 


Similarly, we have 


n n-1 
ae ak — On41) R41 = y Sk(be41 — be42) + Snbn41 
k=1 k=1 


= Sn0n+1 = (a4 = L)bn4a + (L + An+1)0n41- 


Letting n — oo yields 


Le (ax - ap+i)bdp < L)by, Ss" ( (ax — Ak41 )De+1 > (a, — L)M. 
k=1 k=1 


Their difference gives 


Co 


(ax a Ar+1) (dK a be41) < (a1 = L)b; = (a1 = L)M — (a1 = L)(by <= M). 
k=1 


This proves the inequality as claimed. 
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We next provide one example involving rearrangements of the alternating har- 
monic series. 


Let 


See Us pe Oe a a 
Pe re Be A eS 
Show the series converges and find the value to which this series converges. 


Proof. Notice that 


l 1 
a3k Ok’ a3k—-1 4k — 1° oe? 4k — 3 
Thus, 
: é _ 8k —3 
A3k—2 + G3r-1 + A3k = (4k — 3)(4k — 1)(2k)’ 
and so 


w 


nm 
(@3x—2 + 3-1 + 43x) 
k=1 k=1 


” 8k — 3 
=a 


<+ (4k — 3) (4h — 1)(2k) 


By comparison with the series )>°., 1/k?, we see that $3, converges. Therefore 
the original series converges as well by Theorem 2.23. 


To find the value to which this series converges, observe that 


id ied. “ad i 
Sn = (145 5)+(E+3 )+Gts z) te 

-(1 £0 ae itt ol oe 
5 QB me ALORS 16 GOP 3B 8 

-(1 i aye ae ia 4 (2 ) 
DB ap Ne ays 8 

-(1 a ee are bt Ay a 
53 eG ko Ae 8 an 


In view of the well-known result $>°~_, (—1)"t"/n = In2, we find the series con- 


3 
verges to 5 In2. 


The following two problems illustrate how to use definite integrals to evaluate the 
series in closed form. 


(Monthly Problem 11400, 2008). Let ¢ be the Riemann zeta function. Eval- 


uate 
co 
ey n(n + f 
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Solution. For 0 < x < 1, we have 


n=1 n=1 k=1 n=1 
-2-*(0-(2))-- (Hh 0-(2))) 
aieiy (Sa) (2.26) 


where the power series of In(1 — x) and the infinite product of sina /x have been 
used. Since all terms are positive, reversing the order of summation and integra- 
tion gives 


1 
1 
=— | In(sin(a/x)dx + Ina — 5 
0 


2. fe 1 
--3 | t In(sint) dé + Ina — 5 
=In2+1 = =In(2n) — = 
= in N77 rms TT 9” 


where we have used 7 


1 
t In(sin t) dt = =5 n? In2. (2.27) 
0 
To see this, by symmetry, we have 


| t In(sint) dt = i] (x — t) In(sin(a — t)) dt, 


sO 
TT 


| t In(sint) dt = — | In(sin t) dt. 
0 2 Jo 


Appealing to 
| In(sint)dt = | In[2 sin(t/2) cos(t/2)] dt 
0 0 


m/2 m/2 
= min2+2 [ In(sin t) a+2 [ In(cos t) dt 
0 0 


= minz+2 [ In(sin t) dt, 
0 


we find that 3 
| In(sint) dt = —7In2, 
0 


which leads to (2.27). 


Replacing x by x? in (2.26) yields 


> C(2n) on an (2) . 
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Integrating this with respect to x over [0,1] gives 


ee ein = In(27) — 1. 


This, together with the result in Problem 21, leads to the following rational sum 


- 1 
2S ea eed = 2 


n=1 


Let a, be the sequence defined by 


1 = ak 
— 1 = 
ee Sie caome rts » 


Find yy. 9 an/2”. 


Solution. Let f(a) = °7°.9 nx”. By induction, we see that the series converges 
absolutely for |x| < 1. In particular, f(0) = 1 and f(x) > 0 for x € [0,1). By the 
recurrence formula, we have 


= Stas! = Dont Dtasa” = D2 oe” 
n=0 n=0 n=0 k=0 

oe) oe) gr—k oe) ae 

ee eg he ae 


Reversing the order of summation is justified because all terms are positive. Hence 


i oe 
nse) = f 7-2 GeGaD’ 


Using that 
1 .. if 1 
(@+1)G+2) i+1 44+27 
we find that 
LAP DN ae Stee (al In(1 — 2). 
aan a )(@ + 2) “> (aa s)« ( -) ae) 
Therefore, 
S- an /2” = f(1/2) = gin F072) Ine — 7 
n=0 


(Monthly Problem 11409, 2009). For positive real a and 8, let 


a+kInk 
N) 1 
PAO: = So ninn(-1 Tl sreneery 


Show that if G > a, then limy_. S(a, 8, N) exists. 


Worked Examples 


24. 


Proof. Let cy = kink, bp = (@ + €2)en/(8 + Cn41) and 


atCh _ “ pao 
mae TT get = 6 TT(2 ore) (2.28) 


k=3 


We now prove that }~*~_, (—1)”" an converges, so limy-so0 S(a, 8, .N) exists. By 
the alternating series test, and noting a, > 0, it suffices to prove 


(i). G@n41/Gn <1 for all sufficiently large n, and 
(ii). Gn + 0 asn—- oo. 


(i). From the definition of a, in (2.28), 


Qn41 _ n4i(ot+eni1) 


an Cn (8 ah Cn+2) , 


$0 Gn41/Gn < 1 is equivalent to cn 41a+(C244—CnCn42) < Cn8. Calculation shows 
C2 — CnCn42 = In?n+Inn+1+0(1). Because B > a and ¢n41 ~ en = nInn, the 
required result follows. 

(ii). Because limy-+.. bn exists, to show limy4o Gn = 0 it suffices to show that 
the infinite product 


n 


II (1- 5") (2.29) 


k=3 


diverges to zero. Recall Theorem 2.31 in present case, the divergence of 


shows that the infinite product in (2.29) diverges to 0. This finishes the proof. 


We now end this section with two examples to evaluate series by using Able’s 
summation formula (limit version). 


(Monthly Problem 12241, 2021). Prove 


S-yen(L-mae ) > |= ee 


k=n+1 


Proof. Let the proposed series be S. For n > 1, let 


2 1 | 1 
Gn = (-1)"n, On ae In24 S- 7 
k=n+1 
and Ay, = -y_1 dx. Then 
2n 
Aon = > ay =-14+2-34+44---—(Q2n-1)+2n=n; 
k=1 


Aon-1 = SY) ag = Aa(n—1) + dan—1 = (n= 1) — (2n-1) = =n, 
k=1 
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and 
1 1 1 1 1 
Bn = Dn+1 = t 
4n A(n+1) n+l 2n4+1  2(n+4+1) 
_ 1 1 " 1 
~ An(n+1) 2n+1  2n+1) 
1 


~ 4n(n + 1)(2n +1)’ 


Applying Abel’s summation formula: 


S- Anbn => jim, Anbn4i + S- An(Bn = bn+1); 


n=1 n=1 


we have 
An 
An(n + 1)(2n +1)’ 


s= jim, A wus + 3 
Let H,, = 07_, 1/k be the nth harmonic number. Recall that 


i. a 
Hy =) — = = + O(1/n* 
BOSS SS oar 


where ¥y is Euler-Mascheroni constant. We have 


1 
by, = — —m2+ Ho, — An 
4n 


1 iy Al 1 
=q, 72+ (2-5 a Gre 5 OUs/n ) 
1 
~ 16n2 


Using the formulas for A,s above, we find 


+ O(1/n*). 


lim Anbn41 = 0. 
noo 


Therefore, 


Mi 


A4n(n + DGn +1) 


= An _< An 
7 23 An(n +1)(2n +1) © 2 4n(n + 1)(2n + 1) 
- d 8k(2k + 1)(4k +1) uy. —~ 4(2k — 1)(2k)(4k — 1) 


ee Col Re 


oS 1 oS 1 
(> (2k + 1)(4k +1) > Gi sea] 
2In 
4 


oa T *) 
4 


(In2 — 1). 


Worked Examples 


25. 


(Monthly Problem 12287, 2021). Prove 


Proof. Let the proposed series be S. For n > 1, let 


2 
Saal 
AQ, =N, dp = 72 ) 


and A, = doy_, ax. Then A, = n(n + 1)/2 and 


2 2 
1 | oe 
oe ta ®) (> ®) 


k=n+1 =n+1 
i. Oe a 
~ 4 fe ne SS 2 
k=n+1 
Applying Abel’s summation formula yields 
2 fil a al 1 <2? Sed 1 
rs Ras nln epic S (Joost (3 * n? = x) 1) 
n=1 k=n+1 
eee: onl (ntl G1 il 
= Jim 5n(n+ Yous + 5(62) + (8) + > ( Sa :) 
n=1 k=n+1 
ol 1 ile Vy St) 
= lim 5n(n t+ basi + 5(6(2) + 6(3)) + Sy = a ye ye ( ‘2 ae ‘) 
n=1 k=n+1 n=1 k=n+1 
(2.30) 
By Stolz-Cesaro theorem, 
nen 1/k? — 1 1/n? —1 t1)4+1 1 
fim Dhan t/AP— Am _ = U/m®@=A/(n +1) +1/m _ 1 
n—+0o 1/n? n—+00 1/(n + 1)? — 1/n? 2 
and therefore 
es hs (2.31) 
= =-+-—5+4+0(1/n*). ; 
= k2 nn? 
We have 
1 ae | 3 
bn = ( aes 5 t+ 0(1/n ) =, + +0(1/n") 
Hence, 
li : (n+1)b : 
im —n(n ae eae 
ares: aan 
Reversing the summation yields 
a = pe | ul 
ca eae as bak = a ~ fay ee i= 3 
iy bev hyt-y baa-d m0) 
n=1 k=n+1 k=2 n=1 k=2 k=1 


where the well-known Euler sum formula is used in the last equality. 
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Applying Abel’s summation formula again with an = 1, bp = opin 44 1/k?-1/n, 
in view of (2.31), we have 


Me 
foo 
8 
ai 
| 
Sle 
NnN—_” 
lI 
5 
3 
ao 
3 
ae 
+ 
Me 
3 
ON 
3 
+]H 
— 
xs 
Slr 
= 
+)R 
= 
NT 


n=1 \k=n+1 n=1 
= if 
= lim (-= + o(1/n)) Ds CES, =1-((2) 
In summary, by (2.30), we find 
o2 51 COO eee iach = =e 
OA SDS’ 2 
as claimed. 


2.10 Exercises 


I have always grown from my problems and challenges, from the things that don’t work 
out. That’s when I’ve really learned. — Carol Burnett 


1. Let p>0,q > 0, and r > 0. Determine the convergence of the series 
Y sae 
< nP In? nin"(Inn) , 


2. Determine the range of a such that 


ee qi tl/24+1/3+---+1/n) 
n=1 


converges. 


3. Let a, > 0 for all n € N. If °°, ap converges, prove that the series 


nP 
n=1 


converges for all p > 1/2. 


4. Determine the convergence of the following series 


(1) Se sin (n/n? +1) (2) s (1 Ste ~) sin na 


n=1 n=1 


Exercises 


5. 


10. 


11. 


Show that a series of the form ” 


1 
eae 
n=1 
with r, > 0 and limp. rn = 0 could either converge or diverge. 
Let a, > 0 for all n € N. Suppose that $°°°_, a, diverges. 
(a) Prove that 37, Ti. diverges, but Net =a 
(b) Determine the convergences of the series 


[oe) [oe) a 
‘Tr 
ies 72 and 2d, Tina: aa 


an 


converges. 


(Monthly Problem 12004, 2017). Let a,, be a strictly increasing sequence of 
real numbers such that a, <n? Inn for all n > 1. Prove that the series 


Co 
De a An+1 — 


diverges. 


Consider two standard series of the logarithmic scale 


1 — 1 
ene d tasted 
2d nnn d ninnIn?(Inn)’ 


It is well-known that both series converge if and only if p > 1. If 


1 1 
(1) lim (ia, eee oom (2) lim (nInna,)?/ man) gee 


noo e noo e 


prove in each case the corresponding series )>~_, ay converges. 


Let a, be a positive sequence and let 


a nm 

; 1 

A= lim ( ua ) 
noo An 


Show that 


(a) if A < 4, then >>, an converges, 
(b) ifA > 4, then °°, an diverges. 


Assume that f(a) is positive and monotone decreasing on [0, co). Let 
_ (es(e*) ) 
p= lim ( 
ri (F(a) 


(a) ifp <1, then >~, f(n) converges, 
(b) ifp>1, then >>, f(n) diverges. 
Let x; = 1 and for n > 1, 


Show that 


Ungidin $1 = faz +1. 


Does the series )7°°_, @p converge? 
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12. 


13. 
14. 
15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 
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Assume that )>>°_, a, converges and a, > 0 for all n € N. Let #(m) be the 
number of terms in {a1,a2,...,@m} satisfying a, > 1/n. Prove that 


lim zi) 


moo m 


= 0. 


1 l¥anyi 


Let ad», be a positive sequence. Prove that >>°_, eae 


diverges. 
Let a, > 0. Define an41 = n(1+a,) for n € N. Prove that Need Gn diverges. 
(Putnam Problem 2020- Be): Let a9 = 17/2, and let an = sin(an_1) for n > 1. 


Determine whether }°°~_, a? converges. 


(Putnam Problem 2008-A4). Define f : R > R by 
x, if 7 <e, 

fla) = { ef(In«z), ifa>e. 
Does 37°, 1/f(n) converges? 
Let a, be a positive sequence and b, = sitaet ten | Prove that if eee 1/an, 
converges then )>~~_, 1/b, also converges. 
Let a, be a positive sequence and b, = (a1a2°--: tie ele Prove that if 377°, an 
converges then }-~~_, 62 also converges. 


Let S°**_, an be a convergent series and a, > 0 for all n € N. Let bp, = 1/na?. 
Prove that 


a bi + bg +--+ + bn 
converges. 
Let ay be a positive increasing sequence and the series )>~, 1/a, con- 
verges. For every k € N, prove that °°, (Inan)*/an converges if and only if 
2, (Inn)*/an converges. 


(Monthly Problem 11649, 2012). Let a, be a nonnegative sequence and p > 1. 
Show that 


¥ (Sa) <= @ L(Y a) <0 


Let p,g,r € N. Prove 


Y fe 


co 
ae, fae 
<= (pn +q) on gap pr —~q+pk 


For z £ 0, show that 


n 


ers a1 a2 k-1 = aj,a2 RA: 
x+ ay — (e+ 41)(@ + a2) ++ (@ + ax) x «x(x+a,)(a@+a2)--- (a+ ax) 


For k € N, show that 


OF ee 9k k 1 
— In2 aie 
ee ee 


n=1 
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25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


Show that 


where ¥ is the Euler-Mascheroni constant. 


(Pi Mu Epsilon Problem 1351, 2018). Let ¢(3) be Apéry’s constant which is 
defined by $°°~_, 1/n?. Show that 


oS 1 
¢(33)=1+ >> adn 
n=1 


This series has the convergence rate O(n~") instead of O(n~8). 
Let F,, be the nth Fibonacci number. Prove that 


L. ena0 Fifi = 2 V5. 
2. nao Fax = 3 (7— V5). 


Let F;, be the nth Fibonacci number. Define S, = S7;_, F?. Evaluate 
= 1 
= 4, n+1_—_ : 
2 ae 


(Putnam Problem 2016-B1). Let xo, 21,22... be sequence such that 2p = 1 
and for n > 0 
Lnt1 = In(e*” — xy). 


Show that the infinite series 
Lot +%o+°:: 


converges and find its sum. 
(Putnam Problem 2016-B6). Evaluate 


(yet 
» k ms kar +10 
k=1 n=0 


(Putnam Problem 2021-B2). Determine the maximum value of the sum 


over all sequences a1, a2, a3,+++ of nonnegative real numbers satisfying \77~_ | an = 
1. 


(Monthly Problem 11910, 2016). Let F, be the nth Fibonacci number. Find 


= 1 1 1 1 
arctan + arctan + arctan arctan i 
2d ( Fan—3 Fan—2 Pyn-1 ~) 
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33. 


34. 


35. 


36. 


37. 


38. 


39. 
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Let 0, Qn = 8. Prove that 


1. limy—soo 4 ag 


ai+2ag+++Nan __ 
2. ye 1 n(n+1) ee 


(Putnam Problem 2002-A6). Fix an integer b > 2. Let f(1) = 1, f(2) = 
and for each n > 3, define f(n) = nf(d), where d is the number of base-b digits 
of n. For which values of b does 


YH 
n=1 f(n 
converge? 


Let d,, be the number of digits of n in its decimal representation. Show that 


1 9 109 
ey ees | 
qi 1 —) 
n=1 
Let seu) 
T TX — SIN( TL 
TM?) = 56 a8 cos(ara/2)" 
For x ¢ Z, find 


in closed form. 


(Putnam Problem 2011-A2). Let a), a2,... and bi, b2,... be sequence of pos- 
itive real numbers such that ay = b; = 1 and by, = bn—1ay — 2 for each n > 2. 
Assume that the sequence b,, is bounded. Prove that 


oo LL ay,ag: 


n=1 
converges, and evaluate S. 
For n EN, let an = 1/(In(n + 1) — Inn). Prove that 


SF, (an — n)? ae 1 
= (an +n)(an +n+1) 8 3° 


(Hardy-Landau’s Inequality). Let a, be a positive increasing sequence. If 
yo, @ converges for p > 1, prove that 


S ps atte) < (54) Law. 


n=1 


(Carleman’s Inequality). Let a, > 0 for all n € N and suppose >”, an 
converges. Prove that 


Yaa nee Yo 


where e is the best possible constant. 
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41. (Discrete p-Hardy Inequality). Let a, be a sequence with ag = 0. The cele- 
brated discrete p-Hardy inequality claims that 


Jan|? 2 
yo a cS hon tal 
Prove this inequality can be improved to 


5 Janl? Dn < Slt — ie 


n=1 


n+1 n—-1 1 
by, = 2 Ss ‘ 
/ n / n 4n2 


42. Let a, > 0 for all n € N and 0°, a? < oo. Show that 


where 


Hint: First show that, for every m € N, 
Y es 
24 Yntm+n) ~ 
43. Is there a sequence a, a@2,... of positive real numbers such that S77, - con- 


verges, and J];_, a <n” for all n? 


44. Let p(n) : Z— Z be a quadratical polynomial. Find all possible values of 


45. (Monthly Problem 11999, 2017). Evaluate 


(-1)P 


Lyre | 


pie n(n +1) 
46. (Monthly Problem 11384, 2008). Let p, denote the nth prime. Show that 


ae 


1)lv"] 


converges. 
Remark. The published solution has a defect which made an unjustified use of 
the alternating series test. 


47. Let p,m €N. Prove that the series 


converges if and only ifp+1/m> 1 


(all 
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48. (Putnam Problem, 2001-B3). For any positive integer n, let (n) denote the 
closest integer to ,/n. Evaluate 


—(n) 


eae cL ee 


49. Given the alternating harmonic series 


SS (-1)"*1 111 
5 ee ae eee 
= n 


consider the rearrangement in such a way that p positive terms and q negative 
terms occur alternately. Show the resulting series converges to In(2,/p/q). 


50. It is well-known that L = 1-44 5 Poe 7: For a fixed p EN, let R be the 
rearrangement of L by grouping 2p positive terms followed by p negative terms. 
Show that R converges and find its value. 


51. Let S be the series obtained from the harmonic series by deleting the terms 
contains the digital 9. Prove that S converges and its sum is not exceed 80. 
52. Start with the harmonic series 
1 1 


1 
Vise, ee A 
otk eee 


Create a new series as follows: p positive terms and q negative terms occur al- 
ternately without changing the order of the terms. Show the resulting series con- 
verges if and only if p = q. 


53. Let aj =2 anda, =+ yy , ka, for n > 2. Evaluate \7°, Qn/4”. 


54. Determine whether ne series 


y De ae ol 1 
4n—3 4n—-2  4n—-1 4n 


converges. If it converges, find its sum. 


55. Find a necessary and sufficient condition on (a1, a2, a3, a4) for the series 


3 ay 4 a2 ; a3 ; aa 
+ \4nt+1° 4n+2 0 4n+3° 4n+4 
to converge, and determine the sum of the series when that condition is satisfied. 
56. (BBP-Type Formulas). Show that 


Fei 
nae = = 
i ae e $< eer 


Lee. A 8 4 1 
1/3)=—5 
arctan(1/3) 39 a 64” (= +1 4n+2  4n+ 3) ) 


a 2 1 1 
<2 le 8n+1 8n+4 B8n+5 8n+6/)° 
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Remark. Originally, the BBP (named after Bailey-Borwein-Plouffe) formula is 
the last formula above discovered by Simon Plouffe [11] in 1995. Amazingly, this 
formula permits one to calculate the nth hexadecimal or binary digit of 7, without 
computing any of the first n — 1 digits, by means of a simple algorithm that does 
not require multiple-precision arithmetic. Following the discovery of this formula, 
similar formulas for other mathematical constants have been investigated. This 
type of formulas [10] are now called as BBP-type formulas. 


57. Show that 


oo 1 we n/2 
arctan ¢ = S a (; . :) sin(nd), 
n x 


n=1 


where 6 = arcsin(1/V1 + 22). Use this result to derive the BBP-type formula 


oS (-1)” 2 2 1 
r= totam): 
omer 4n 4n+1 4n+2 4n+3 


58. (Monthly Problem 11930, 2016). Find 


= 1 
y sinh~* ( ) : 
= V2rt2 424/27 +2 


59. (Monthly Problem 11932, 2016). Let r be an integer. Prove that 


Co . 
sinhr 

y arctan ( ) = Tr. 
cosh n 


n=—Co 


60. (Monthly Problem 11952, 2017). Prove that 


oy a (eo) =7— 2. 


61. Evaluate 


3 ek re : 
_ ad meet ae” Int1) ° 


62. Let h be the alternating harmonic series. Consider the rearrangement series of h: 


(og tet te 
24 3 5 7 6 8 10 12 9 , 


Is this rearrange series convergent? If so, can you find its value? 


63. Assume that )>~ , a, converges to S conditionally. Let \>~, Qg(n) = T bea 
rearrangement of S. If S # T, show that, for any positive integer N, there exists 
n €N such that |n — o(n)| > N. 


64. Let p> 1. Show that 


nP 


ae 5 (14g tt 5) = 5 (CW) +600), 


where ¢(p) = )>°~_, 1/n? is the Reimann zeta function. 
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65. For |a| <1, prove that 
= 2n 1 
ss C(2Qn)a*" = 5m cot(mx). 
n=0 


66. Show that 
(1) 300, — fC | =Inn— 1. 


n=1 n(2n+1)22” 


(Qe ce settee = In2— 7, where y is the Euler-Mascheroni constant. 


67. Let f(x) = >>. 4 anz”. Prove that 


> an(¢(n) — 1) = > f(1/n). 


Use this formula to show that 
(1) Sopes (C(2k) — 1) = 3/4, 

(2) Sete (-1)*(¢(A) — 1) = 1/2, 
(3) 


68. Let H, be the nth harmonic number. Prove that 


(1) eee a (¢(2) Soret #7) = ¢(3). 


SDs S(k)— 3 = 1-7, where ¥ is the Euler-Mascheroni constant. 


k 
(3) SO, An (C(3) — Spey #e) = 2¢(3) — ¢(2).. (Monthly Problem 11810, 


(4) Oe, Po A, = - 2 ¢(5). 


n=1 16 


69. (Monthly Problem 12134, 2019). Evaluate the series 


70. (Monthly Problem 12194, 2020). Evaluate 


as 1 
Ay hn ye 
Y (Han —9- 3) 


where H,, = >;_, 1/k and ¥ is the Euler-Mascheroni constant. 
71. (Monthly Problem 12102, 2019). Prove 


n 


yee (ce La =| =2 ¢(2) — 2¢(3) 


k=1 


where H,, = )>;_, 1/k is the nth harmonic number. 


Exercises 


72. 


73. 


74. 


79. 


76. 


77. 
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(Monthly Problem 12206, 2020). Prove 


where H,, = )>;_,(—1)**"/k is the nth skew-harmonic number. 


(Monthly Problem 12215, 2020). Calculate 
1 
Qn) 


3 (a+ouptopt: 


(Monthly Problem 12262, 2021). For a nonnegative integer m, let 


Co 


1 1 
Am =) (a +1241 (6k + Saad) 


k=0 


Prove Ag = 7V/3/6 and, for m > 1, 


n-2n 


“ (=1)"r 7 
DA. te om Amn = 


(Monthly Problem 11068, 2004). For a rational number x that equals a/b in 
lowest terms, let f(x) = ab. 
(a) Show that 

1 5 
f(e 2? 


> 


xrEQ 
where the sum extends over all positive rationals. 
(b) More general, exhibit an infinite sequence of distinct rational exponents s 


such that : 
mol 
is rational. 
Show that 
(a) Vico were + Lito GRE? = 37 (3), 
fe) oo ia 
(b) dox=o (BEHDs — a0 (3k4+2)% ~ rae 
~ CO id ~OO k a3 
(c) leo ae + et GER rr re 
sco |= (—1)* roo }§=— (1) 13 
(d) Yee=o GREDF ~ Lk=0 BREDE = 18 6(3)- 


Let k € N. Define 
ee ag mee oe ee ert 
aa 2 k k+l k+2 2k 


is eee eee ee batt eee Di et) 
Rel’ BwaD | 3k 3k+1° 3k+2 4k 
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78. 


79. 


80. 


81. 


82. 


83. 
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(a) Show that H;, > S; > cH; for some c € (0,1). 

(b) Prove that lim, ... (Hy — S,) = In(7/2). 

(c) Find S; in closed form. Check your solution with Sj = (a + 21n2)/4,$3 = 
(2rV/3 + 31n3)/9. 


(d) Show that 
k-1 
; T 2k 
hue & 2k sin(na/k) | a 


n=1 


where ¥ is the Euler-Mascheroni constant. 
(Monthly Problem 12026, 2018). For n €N, let H, = >77_, 1/k and 


Sn = 
k : 
k=1 4 


Hy. 


n (—1)"-* k 
=1 
Find limy5oo Sn/ Inn and limy_+55(S2n — San—1)- 
(Mathieu’s inequality). Show that 
1 = 2n 1 
—__————— = fe . 
aif <2) Dre <@ or « #0 


n=1 


Remark. The series S(x), often referred as Mathieu series , was introduced by 
Emile Mathieu in the study of elasticity of solid bodies. Bounds for this series 
are needed for solving biharmonic equations in a rectangular domain. Various 
refinement inequalities have been established. For example, Alzer et al. [5] proved 


that 
1 1 


> <8 =>. 

2+ iacay) <9) < 2r1/6 
Although this estimate is asymptotically sharp, it leaves a big gap for small z. 
Can you find a best possible estimate of S(a) applicable on the entire R? 


Let S(x) be the Mathieu series defined above. For |x| < 1, show that 


S(x) =2 5° (-1)"**n¢(2n + 1)22-, 
n=1 


Let a, > 0 for alln € N and s, = )77_, ax. Show that 


(1) If 30°, an converges, then S>”°_, a,/s% converges for any real number a. 


2) If Gp diverges, then An /s% converges for a@ > 1 and diverges for 
n=1 g n=1 n g g 
a<l. 


(Putnam Problem, 1948-A3). Let a, > 0 be a decreasing sequence with limit 
0 such that 


be = Gp — 2apn41 + Ox42>0 (for all k= 1,2,...). 
Prove that )>>°_, nbn = a1. 
(Putnam Problem, 1949-B2). Show that 


2 cos(In(In n)) 


Inn 


diverges. 
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84. 


85. 


86. 


87. 


88. 


89. 


90. 


91. 


92. 


93. 


(Putnam Problem, 1966-B3). Let a, > 0 for all n € N. If 30°, 1/a, con- 


verges, prove that 
ne 


co 
ar 2 On 
6 Gn Ga Or) 


also converges. 


(Putnam Problem, 1994-A1). Suppose the sequence a, satisfies 0 < a, < 
Gan + Gan41 for all n > 1. Prove that series Des, Gy, diverges. 
Remark. The inequality can be replaced by an < an41 + Gn2. 


Prove that the series 


Qe Se) (2 .e"") 


Me 


n=1 


converges when a = In2 or a > 1, and diverges when a 4 In2 anda < 1. 


Let na, be decreasing and converge to zero. If }7°°_, an converges, prove that 
limp+o (nInn)an = 0. 


If eat Gy, converges conditionally, prove that the terms can be grouped so as 
to form an absolutely convergent series. 


ais 1 1 1 
S Inf{1+—)-mn(1+—)-In{1 
n(1+5) n(1455) n(tt ona) 


n=1 


Evaluate 


(Monthly Problem 11809, 2015). Let {a,,} be a sequence of real numbers. 


(a) Suppose that {a,} consists of nonnegative numbers and is non-increasing, 
and S~°°_, an/./n converges. Prove that )7°°, (—1)!V"! an converges. 


(b) Find a non-increasing sequence {a,,} of positive numbers such that 
limp sco Van = 0 and 7°, (-1)!v"! a, diverges. 


(Monthly Problem 11260, 2006). Find those nonnegative values of a and 3 


for which 

> I a+kink 

arn B+(k+1)In(k +1) 
converges. For those values of a and (, evaluate the sum. 
(Monthly Problem 11982, 2017). Calculate 


For any x > 0, show that 
ie = a 
T+) = _ =, 
Ge -( zt) 


= 5 me = EET iB 
og OE er Vea D) = eee 


where 


Remark. As an application, a refinement of Carleman’s inequality can be achieved. 
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94. 


95. 


96. 


97. 


98. 


99. 


100. 


101. 


102. 


Infinite Numerical Series 


Let a, be a decreasing positive sequence. Define 


Qn+1 
b, =1—- 7. 
an 


Then a, converges to zero if and only if >>, b, diverges. 

Remark. This may use to show a, — 0 as n — oo. For example, here we can 
show both (2n)!/4"(n!)? and n”™/n!e” converge to zero without using Stirling’s 
formula. 

Let a, be a monotone increasing positive sequence. Define 


an 


iS 


An+1 
Prove that $>>-_, by converges if a, is bounded. 
Evaluate 
(a) 3°, 4" sin4(2-"6). (Monthly Problem 11515, 2010) 
(b) S°°°., ncoth™* n(4n? — 3). 
(Monthly Problem 11853, 2015). Find 


Co 


1 
d sinh 27" 


Let ap = 0,a1 = 3/2, and ay = 3 An 1 — Gn—2 for n > 2. Find a closed form for 
Gp, and determine a Gis 


Prove that 
ni = (= )" v2an I {1+ 1/m)*¥?/e\. 


Let a, = V2, An+1 = 41° Determine 


TI a. 
n=1 
(Putnam Problem 2004-B5). Evaluate 
ey (itantt 
li 
fim Te iy 
(Putnam Problem 2014-A3). Let ao = 5/2 and a, = az_, — 2 for k > 1. 


Compute 
Il (1 ) 
ak 


k=0 


in closed form. 
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103. Let a € (0,1/2). Define aj = a and for k > 1, 


1 Qk e 
a == . 
int 2 1-— Qk 


Compute 


k=1 
in closed form. 
104. Let a, = 2 and for k > 1, 
2 
Qk+1 = T+ a% 
Evaluate []7-, ax. 
105. (Cantor). Prove that 
z+1 7 ( 1 ) 
= 1 + —— ; 
x—-1 rae dn 


where q) = © > 1,@n41 = 2q2 —- 1. 
106. Evaluate 


co 
II (l+e"). 
n=1 


107. Prove that 


ae 2 cos (“554" r) 
U (+, +n ) 7 (1 — x?) cos(V5m/2) 


108. Show that 


1300 1 QS (-1)"12n4+1)! | 
stud (n + 2)! n! 42" me 


where ¢ is the golden ratio. 
109. (Monthly Problem 11333, 2007). Show that 


Il nead 2(n?—1) pete | n - 
bers n? n—-1 en 


110. (Monthly Problem 11299, 2007). Show that 


ees) ee 


111. (Monthly Problem 12029, 2018). For a > 0, evaluate 


128 


112. 


113. 


114. 


115. 


116. 


117. 


118. 


119. 


Infinite Numerical Series 


(Monthly Problem 12110, 2019). Let a, = (k + Vk? + 4)/2. Evaluate 


Evaluate 


foe) 1 2n?4+n—-1/6 

II m (1 + *) : 
n 

n=1 


(yr AB 
I aS aoe -) ~ 97/12 71/4’ 


Show that 


where A is the Glaisher-Kinkelin constant. 


Le 


(Monthly Problem 11739, 2013). Let B(x) = ( a ) . Consider the infinite 


matrix product 


=[[ B@*) = Be“) B3")BE):--, 


where the product runs over all primes. Find M(t) in closed form and evaluate 
M(2). 
(Monthly Problem 11685, 2013). Prove that 

1] 1 1 


TI (+5) =3+ Tle O 1) 


(Monthly Problem 11438, 2009). Let 


- z—1 
= arctan : 
», (aa IWvk+14 cps) 
(a) Find a closed form expression for P(n) when n is a nonnegative integer. 
(b) Show that lim,_,_,+ P(x) exists, and find a closed-form expression for it. 
( 


Monthly Problem 11499, 2010). Let H,, be the nth harmonic number, and 
let 


=o ‘(Inn — (Hin — Hn)). 


Prove that for k > 2, 


[k/2] 
k-1 1 T (21 — 1)7 
= In2+—=Ink k + 1 - 21) cot | ———— } . 
Sk a 2+ 5 mk- a d | am l) co ( oh ) 
Let p, be the number of consecutive positive summands and let gq, be the num- 
ber of consecutive negative summands that appear in the rearrangement of the 


alternating harmonic series to sum a prescribed real number a. If a > In2, prove 
that 
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120. 


121. 


122. 


(a) dn = 1, 

(b) pr = [b| or |b] +1 eventually, where b = e4¢/4, 

(c) b is rational if and only if p, is eventually periodic. 

Let |g| < 1. Define (q), = aan —q) for k EN. Prove that 


gh(k-)/2 


(a) [pii(1+2q*"') = na 0” (ae z*. (Euler) 


(b ) He 1 ayes T = as 0 no Sh (Euler) 


Hint: Let P,(x) = []p_,(1 + vq*~!). Find the coefficient of x* from (1 + 
x)P, (xq) = (1 + «q”")Py (x). 
(Jacobi’s Triple Product Formula). Let |q| < 1 and z € C. Prove that 


_ = _ 2 
(1 +4 zqrk Ya 42 147k piel = qv") = a q® ok. 
‘L. k=—0o 


ae 


> 
Il 


(Pi Mu Epsilon Problem 1401, 2023). Let m be a positive integer. For |q| < 1, 
prove 


Co 


2k+1 7 
y cos (Ae) gh ®+)/2 — cos(x/m) IT (1+ 2cos(2r/m)q* + q?*)(1 —9*). 
m 
k=0 k=1 


Use this result to deduce the recent Monthly Problem 12289, 2021: 


Co 


Yo 200 (Ao (2k +1)7 =) ghht/2 = Ia — g®1)(1 — g®*-8)(1 — gh), 


k=1 
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Continuity 


The whole of mathematics is nothing more than a refinement of everyday thinking. 
— Albert Einstein 


In most sciences one generation tears down what another has built, and what one has 
established another undoes. In mathematics alone each generation adds a new story to 
the old structure. 

— Hermann Hankel 


The importance of continuity can hardly be overemphasized in the context of analysis. 
Sequential theorems related to continuity and set properties, including the extreme value 
theorem, the intermediate value theorem, and the uniform continuity theorem, constitute 
the fundamental core of analysis. In this chapter, we give various proofs of these three 
fundamental theorems based on the completeness theorems of the real numbers. Surpris- 
ingly, we see that each of these three fundamental theorems is logically equivalent to the 
completeness of the real numbers. As a consequence of the intermediate value theorem, we 
present Li-York’s beautiful result “periodic three implies chaos.” 


3.1 Definition of Continuity 


Mathematics is an experimental science, and definitions do not come first, but later on. 
— Oliver Heaviside 


In Chapter 1, we studied the sequences of real numbers, which can be viewed as real- 
valued functions defined on N. We now begin the study of real-valued functions defined 
on a general subset D of R, especially those defined on an interval J in R. Continuity 
and differentiability are two essential concepts that display the nature of functions. Before 
Cauchy and Weierstrass, the continuity of a function is built on geometrically intuitive 
notions such as “Its graph can be drawn without lifting the pen from the paper” or “Its 
graph has no jumps or gaps.” Why did the formulation of a rigorous definition of continuity 
take so long? The basic reason for this two-hundred-year waiting period lies in the fact 
that, for most of that time, functions were thought of as being composed of elementary 
functions such as polynomials and trigonometric functions, which are always continuous on 
their relevant domains. In the early 19th century, mainly under the influence of Fourier’s 
heat equation and Dirichlet’s study of Fourier series, the gradual liberation of the concept 
of function led to its modern definition—a rule associating a unique output to a given input. 
A typical question was whether the continuity of the limiting polynomials (power series) or 
trigonometric functions (Fourier series) necessarily implied that the limit f would also be 
continuous. The intuitive notion of continuity no longer met this kind of challenge. 
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Cauchy (1821) introduced the concept of continuous functions: 


The function f(a) will remain continuous with respect to x between the given limits, if be- 
tween these limits an infinitely small increasing of variable always produces an infinitely 
small increasing of the function itself. 


Weierstrass was more precise: the difference f(x) — f(z) must be arbitrarily small, if 
the difference x — Xo is sufficiently small. 


Definition 3.1. Let D be a subset of R. The function f(x) : D > R is continuous at 
xo € D if for every € > 0, there exists ad > 0 such that 


| f(x) — f(@o)|<€ whenever x € D and |x — xo| < 6. (3.1) 


The function f(x) is called continuous on D, if it is continuous at every point xo € D. 


This kind of mathematical style of Weierstrass installed rigor in analysis: the cutting 
up of “epsilons,” the systematic use of inequalities and majorization. All of which becomes 
the daily bread of modern analysis. Historically, Klein referred to these movements as “the 
arithmetization of analysis.” 

With a mathematically unambiguous definition for the limit of a sequence in hand, we 
are well on an alternative way toward a rigorous understanding of continuity—the sequential 
characterization which is equivalent to the above ¢ — 6 definition. 


Theorem 3.1. A function f(a): D— R is continuous at xp € D if and only if for every 
sequence Ln € D we have 


f(an) > f(xo) whenever rp, > Xo. (3.2) 


Proof. Suppose f is continuous at xo. For every € > 0, choose 6 > 0 as in (3.1). Since 
Ln — Xo, there exists a positive integer N such that |x, — xo| < 6 for all n > N. It follows 
that |f (an) — f(ao)| < € for all n > N and so (3.2) holds. 

Suppose now that (3.2) holds, but that f(z) is not continuous at x9. Then there exists 
€ > 0 such that for every 6 > 0 there exists « € D with |x — xo| < 6 but | f(x) — f(ao)| > €. 
In particular, for every n there exists x, € D with |x, — xo| < 1/n, hence x, — xo. But at 
same time |f(%n) — f(%o)| > €, which contradicts (3.2). 


As the following examples illustrate, working with the sequential criterion (3.2) on con- 
tinuity is sometimes more convenient than using € — 6 definition (3.1). 


Example 3.1 (Dirichlet’s Function). Define 


1, if x is rational, 


ae { 0, if x ts irrational. 


Since Q is dense in R, technically, there is no way to graph D(x) accurately. Moreover, 
D() is nowhere-continuous on R. Indeed, for any xo € R, there is a rational sequence ry, 
that converges to xo, and also a irrational sequence q, that converges to xp. Since 

lim D(r,)=140= lim D(q,), 
noo n+ Co 
this implies that D(a) is not continuous at zo. 


The following example indicates that there exists a function that is continuous at one 
and only one point. 
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Example 3.2. Define 
x, if x is rational, 
je={ 9 4 


~ | 0, if x ts irrational. 


For any tp # 0, just as we did in Example 3.1, we can construct rational sequences 
Tp — Xo and irrational sequences gq, + Xo such that 
lim f(tn) =o and lim f(q,) =0. 
n> Co noo 


Hence f(x) is not continuous at every point 1p 4 0. 
We now show that f(x) is continuous at x = 0. For any « > 0, let 6 = «. Then 


_ f |z|, if x is rational, 
|f(x) — f(O)| = { 0, if x is irrational. 


Thus, 
| f(x) — f(0)|<e whenever |x —0| <6. 


So f(x) is continuous at x = 0 only. 

This example also forces us to emphasize the continuity at a particular point rather 
than over an interval. This is a significant departure from thinking of continuous functions 
as curves that can be drawn without lifting the pen from paper. The following example is 
even more surprising. It was discovered by Thomae at 1875. 


Example 3.3 (Thomae’s Function). Define 


1, ifx=0, 
T(z)=¢ 1/q, ifx=p/q in lowest terms with q > 0, 
0, if x is irrational. 


If zo € Q, then T(xo) > 0. On the other hand, there is an irrational sequence gn 
converging to x9, which yields 


im, T(dn) =0 A T(2o). 


Thus, T'(a) is not continuous at every rational point. The twist comes when 2p is irrational. 
We have seen that all irrational sequences converge to zero by T(x). Thus, if xo is irrational 
and T(a) is continuous at x9, then T(r,) must converge to zero for all rational sequences 
Ty With ry, > Zo. 

We first see how this can be done with an example. Let rp = e = 2.718281828.... A 
particular rational approximate sequence r,, is 


27 271 2718 27182 271828 2718281 
10’ 100’ 1000’ 10000’ 100000’ 1000000 


{2 ae 


In this case, we have T(r,;,) as 


a 1 1 1 1 1 1 } 
* 10’ 100’ 500’ 5000’ 25000’ 1000000 


which is fast approaching 0 = T(e). We prove that this always happens. To this end, for 
any irrational number a, let k be the closest integer to a. Then a € (k — 1,4 +1). For any 
given € > 0, choose N € N such that 1/N < e. Notice that, on (k —1,4+1), the number of 
fractions in the form of p/q with 0 < q < N is finite (for example, the only such fractions with 
denominators 5 or smaller in (—1,1) are 1/2, 1/3, £2/3, +1/4, £3/4, £1/5, £2/5, +3/5, 
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and +4/5). Hence we can find some 6 small enough that interval (a—6,a+6) C (k-1,k+1) 
and it contains none of these fractions. For any x with |x — al < 6, if = p/q in lowest 
terms, then 


< : < 
—<e 
N 
since q > N. Alternately, if x is irrational, then 
|Z(x) — T(a)| = |T(x)| =0<e 
as well. In either case, we have found a 6 > 0 such that 
|T(a) —T(a)|<e whenever |x — al < 6. 


This proves that lim;_,. T(x) = 0 = T(qa) as desired. In summary, we demonstrade that 
T(a) is continuous at every irrational number and discontinuous at every rational number. 

In general, to prove discontinuity of a function at a given point x9, we can phrase the 
discontinuity in terms of the sequential characterization. 


Theorem 3.2 (Criterion for Discontinuity). Let f(x): D— R and xo € D. If there 
exists a sequence Lp, € D with Ln + Xo but such that f(a,) does not converge to f (x9), 
then f is discontinuous at xo. 


Example 3.4. Define 
_f sin(I/e), ifr £0, 
se)={ 9 n=O, 
Clearly, the sequence x, = 1/(2n7 + 7/2) > 0 as n > cw, but 


f(an) = sin (2nz + =) = sin (5) =1 f(0), 


so f is not continuous at x = 0 (see Figure 3.1). 


FIGURE 3.1 
f(x) =sin(1/z), « 40. 
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3.2 Limits of Functions 


Mathematical knowledge adds a manly vigor to the mind, frees it from prejudice, 
credulity, and superstition. — John Arbuthnot 


Assume that f(x) is not continuous at xo or not even defined there; in such a situation 
it is interesting to know what happens to f(x) as x approaches zo. We begin with a general 
definition of a functional limit lim,_,,, f(a) = L, which is similar to the definition of limit 
of a sequence. 


Definition 3.2. Let f : D — R and let xo be a limit point of D. We say that 
lim,.+2, f(x) = L if for any € > 0, there exists ad > 0 such that 


|f(z) —L|<e whenever 0 < |x — 2| < 6. 


In contrast to the definition of continuity, here the additional inequality 0 < |x — xo| 
is just a short-cut for saying x # xo. We see from this definition that the issue of what 
happens when x = Zp is irrelevant from the point of view of functional limits. Indeed, xo 
may not even be in the domain of f. 

Equivalently, in terms of sequences, we have 


Definition 3.3. lim,_,2, f(x) = L if for every sequence «, € D satisfying tn A xo and 
In > Xo, we have 
lim f(t) = L. 


n—->co 


Since the limit of a sequences is unique, we see that the limit of a function, when it 
exists, is unique too. We now introduce two standard but weaker limits—right and left- 
sided limits, which are of particular interest in connection with monotone functions, as we 
will study in Section 4. 


Definition 3.4. Let f : D— R and let xo be a limit point of D. We say that the right-hand 
limit lim, + f(x) =L if for any € > 0, there exists ad > 0 such that 


|f(z) —L| <e€ whenever rp <a < a+. 


Similarly, we define the left-hand limit lim, _,25 f(x) = L if for any « > 0, there exists a 
5 > 0 such that 
|f(x) — L| <€ whenever 19 —5 <u < 2. 


As an application of one-sided limits, we can classify the discontinuity of a function into 
one of the following three categories. 


Definition 3.5. Let f be discontinuous at xo. 
(1) If limz+2, f(a) exists but differs from f(xo), then f has a removable discon- 
tinuity at xo. 


(2) If both sided limits exist but are distinct, then f has a jump discontinuity at 
XO- 


(8) If limz+2, f(a) does not exist for some other reason, then f has an essential 
discontinuity at xo. 


136 Continuity 


FIGURE 3.2 
Examples of three types of discontinuity. 


The following three examples illustrate each discontinuity at « = 0, respectively (see 
Figure 3.2): 


= (@) see) =sin(4). 


x x 


It is also interesting to see that Dirichlet’s function in Example 3.1 has an essential 
discontinuity everywhere, while Thomae’s function in Example 3.3 has a jump discontinuity 
at every rational point. 

It is easy to prove algebraic limit theorems for function limits using established properties 
of sequences. In particular, we have the following economical way to show the nonexistence 
of a limit. All proofs are left to the reader. 


Theorem 3.3. Let f : D—R and let xo be a limit point of D. If there are two sequences 
Ln, Yn © D satisfying tn A 0, Yn # Lo and 


lim tp, = lim y, =2o but lim f(a) 4 lim f(yn), 
n—0o n— oo noo noo 


then lim,_.,, f(a) does not exist. 


3.3. Three Fundamental Theorems 


All the truths of mathematics are linked to each other, and all means of discovering 
them are equally admissible. — Adrien-Marie Legendre 


The behavior of a continuous function defined on an interval is at the root of the analysis. 
If f(a) is continuous at xo, we can rewrite the criterion as 


lim f(#) =f ( lim c) ; 
w+ xo L—>Zo 

In other words, f commutes with the lim,_,,., if f is continuous. An interesting question is to 
sort out what happens when Zo is replaced by a particular set D C R. In this section, using 
solely the completeness theorems of the real numbers in Section 1.1, we rigorously establish 
the basic properties of such functions in three fundamental theorems when D = [a, bj, a 
finite closed interval in R. The requirement of the finite closed interval is not incidental. 
As we will see, these fundamental theorems depend not only on the continuity of f but 
also on the topological properties of [a,b]. For example, the intermediate value theorem 
depends on connectedness; the extreme value theorem and the uniform continuity theorem 
rely on compactness. Moreover, during the process, we will see how to put the completeness 
theorems into action. 
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We begin with the extreme value theorem, which is used (at least implicitly) all the time 
in solving maximum-minimum problems in calculus because it is taken for granted that a 
continuous function on a closed interval indeed attains a maximum and a minimum. 


Theorem 3.4 (Extreme Value Theorem). Let f be continuous on [a,b]. Then f is 
bounded. Moreover, f attains its maximum and minimum on [a,b], i.e., there are 71,22 € 
[a,b] such that 


min. (F(2)} = flea) < fle) < flex) = max {f(@)}. 

Proof. We show that f is bounded by contradiction. Assume that f is not bounded on 
[a,b]. Then for each n € N there is an x, € [a,b] such that |f(z,)| > n. By the Bolzano- 
Weierstrass theorem, x, has a subsequence z,,, that converges to some real number 2% € 
[a,b]. Since f is continuous at x, we have limp... f(@n,) = f(%o0), which contradicts 
limg+oo | f(@n,)| = 00. This proves that f is bounded. 

Let M = supyzeja, {f(x)}. By the preceding argument, we already know that M is 
finite. We now show by contradiction that f attains M at some real number 2; € [a, 0]. If 
there is no number 2; € [a,b] such that f(a1) = M, then 1/(M — f(a)) is continuous and 
bounded on |a, b]. Let 


1 
oS, 
M — f(x) 
where m is some positive constant. Thus, 
1 
f(iz)<M——. 
m 


This contradicts the definition of M@. Thus f assumes its maximum at some 2; € [a,b]. 
Applying the above argument to —f, we conclude that —f assumes its maximum at some 
x2 € [a,b]. It follows that f assumes its minimum at 22. 


An alternative proof of the boundedness based on the nested interval theorem is as 
follows. 


Proof. Assume that f is unbounded. We show that f must be discontinuous at least one 
point xo € [a,b]. For this purpose, we use the nested interval theorem to find such a point 
zo. By induction, we define 


1. ay = a,b, = b,m, = (a, + b,)/2. The function f must be unbounded on at 
least one of [a1, m1] and [mm , b1]. Choose one of them on which f is unbounded 
and define the interval as [ae, bg]. 


2. Suppose that [a,,6,] is an interval on which f is unbounded. Let m, = 
(dn +b,)/2. Choose one of [a,, My] and [m,,, b,] on which f is still unbounded 
as [Qn+41, bn+1]- 


Thus we see that f is unbounded on every [an, b,] and 
AL an LS An41 < basi < bn < 6, 


and 
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By the nested interval theorem, both a, and b, converge to x9 € [a,b]. We now show that 
f is not continuous at xg. To see this, let € be any positive number and suppose there exists 
a 6 > 0 such that |x — xo| < 6 implies 


|f(x) — f(xo)| <e. (3.3) 


On the other hand, there exists a sufficiently large n such that b, — a, < 6, so every 
x € [dn, by] satisfies |x — xo| < 6. Recall that f is unbounded on [a,,b,]; it follows that 
there is at least one x € [an,b,] for which f(x) > f(ao) + € or f(x) < f(ao) — €. This 
contradicts (3.3). 


As an example of the “existence theorems,” the above proof only shows us the maximum 
exists, but does not reveal where the maximum occurs. Based on the Bolzano-Weierstrass 
theorem, we now give another proof of the extreme value theorem which also demonstrates 
how to find the maximum. 


Proof. Let M = sup,zeja.) {f(2)}. The definition of supremum implies that f(x) < M for 
all x € [a,b]. We now show how to use the Bolzano-Weierstrass theorem to find the point 
xo € [a,b] such that f(x9) = M. To this end, let n > 1 be any integer. Since M — 1/n is 
not an upper bound, there exists a x € [a,b] such that M —1/n < f(z). 

We now construct a sequence «, by choosing 


for each n, &, € [a,b] such that M— + < f(z,). 


By the Bolzano-Weierstrass theorem, there exists a subsequence xp, which converges to a 
number 9 € [a,b]. We now show that f(a) = M. Since f is continuous, as usual, we have 


dim flan.) = feo). 


On the other hand, in view of the construction of the sequence, we have 


1 dl 
f(an,) > M-—>M--— 
Nk k 


and so by taking limits of both sides we see that 


feo) = jim, F(@m,) > jim (=) =M 


Combining the inequality f(a) <M we have f(2o) = M as desired. 


Let f(x) = x(1 — x) on [0,1]. The sequence x, = 1/2 — 1/n for n > 3 is one of the 
desired sequences in the above proof to approach the maximum value 1/4. The following 
examples show that Theorem 3.4 is false if either f is discontinuous or [a,b] is replaced by 
an open interval. 


Example 3.5. The function f(x) =1/x is continuous but unbounded on (0,1). The func- 
tion g(x) = x? is continuous and bounded on (0,1), but it does not have a maximum value 


on (0, 1). 
Example 3.6. Define 
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FIGURE 3.3 
f(x) =sin(1/z)/x, « 40. 


This function f is not bounded on [0,1] even though f is continuous on (0, 1] (see Figure 
33). 

The extreme value theorem demonstrates that a continuous function f attains both 
maximum and minimum. The following theorem shows that f indeed achieves every value 
in between. This result is pictorially obvious. A curve without break points cannot jump 
from one height to another. It must past through every intermediate height. 


Theorem 3.5 (Intermediate Value Theorem). Let f be continuous on [a,b]. If c lies 
strictly between f(a) and f(b), then there is a point xo € (a,b) such that f(a) = c. 


Proof. Without loss of generality, we assume that f(a) < c < f(b). By induction, we define 


1. ay = a,b; = b. 


2. Suppose that [an,bn] has been defined such that f(an) < c < f(b,). Let 
Mn = (Gn + b,)/2. If f(mp) =c, then we are done. Otherwise, 


(i) If f(mn) <c, let Qn4i = Mn, bn4i = dn. 
(ii) If f(mn) > c, let Qng1 = Qn; bn41 = Mn. 


Thus we see that, for each n, 


a <n < Anti < bn41 < bn <b, 


and ‘ 1 
bn io) = 

5 bn — Gn) = op 

By the nested interval theorem, both a, and b, converge to x € (a,b). Since f is continuous 

on [a, bj, it follows that 


bri — antl = (b a). 


(wo) = Jim flan) $e 


and 
F(zo) = Jim, f(bn) > ¢ 


Consequently, f (ao) = c. 
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Here is another proof based on the least-upper-bound property. 
Proof. Assume that f(a) <c< f(b). Let 
S = {ax e€ [a,b]: f(x) < ch. 


Since a € S and S C [a,b], S is nonempty and bounded. So xp = supS exists by the 
least-upper-bound property, and 2 € [a, 6]. We now show that f(r) =. 

For n € N, xp — 1/n is not an upper bound of S, so there exists x, € S such that 
Ln > Xo — 1/n. Thus, 


1 
rt - _— Slr Xo. 
n 
By the squeeze theorem, we have limy_,.5 Zn = Xp. The continuity of f implies that 


slim, f(arn) = (#0). 


Since z, € S for every n, we have f(x») < c for every n, and so f(a) < c. Moreover, xo < b 
since c < f (6). 

On the other hand, since xo < 0, there exists an N such that 29 +1/n < b for alln > N. 
Since 7p + 1/n > xo, we have x9 + 1/n ¢ S for all n > N, and so 


f(m+=) > 


jim # (20+ =) = Fl) > © 


The continuity of f implies that 


In particular, x9 4 a since f(a) < c. 
In summary, we obtain f(2o) = c and xo € (a,b), as desired. 


Corollary 3.1. If f(x) is continuous on [a,b] satisfying f(a)- f(b) < 0, then there is some 
c€ (a,b) such that f(c) = 


Recall that a sign chart is often used in calculus to identify where a derivative is pos- 
itive or negative in order to determine where a function is increasing and decreasing. The 
construction of the sign chart itself is simply an application of this Corollary. The bisection 
method used in the construction of the nested intervals indeed provides an approach to 
approximate the value c. 


Example 3.7. Approzimate the solution of x? — 2x —5=0. 
Let f(x) = 23 — 2a — 5. Since 
f(2)=-1<0< f(3) = 16, 


the given equation must have a solution in (2,3). Using the bisection method, we obtain 


Test f(an) <0< f(bn) The root range 
TO <0<TS) omy 

f02) <0 < f(25) (22.5) 

f(2) <0 < (2.25) (2, 2.25) 

f(2) <0 < f(2.215) (2, 2.125) 
(2.0625) <0 < (2.215) (2.0625, 2.125) 
(2.09375) <0 < (2.2125) | (2.09375, 2.125) 
(2.09375) <0 < (2.109375) | (2.09375, 2.109375) 
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Thus, one approximate solution is given by (2.09375 + 2.109375)/2 = 2.1015625 with error 
less than 1/27 = 0.007515. 


Corollary 3.2. If f : [a,b] — [a,b] is continuous, then there is an x € [a,b] such that 
f(x) =2, a fixed point of f. 


Corollary 3.3. If f is a continuous function, then f(a, b]), the range of f on [a,b], is also 
an interval or a single point. More precisely, f([a,6]) = [minzejas) f(®), MaxXzela,s) f(x)]- 


Definition 3.6. A function f has the intermediate value property on [a, b| if for all a1, x2 € 
[a,b] with v1 < x2 and every c strictly between f(x1) and f(x2), then there is a & € (#1, #2) 


with f(€) =e. 


Thus, every continuous function on [a,b] has the intermediate value property. But, the 
converse of the intermediate value theorem is false. Let 


_ f sin(1/z), ifa 40, 
fe={ 6 if x = 0. 


By Example 3.4, f is not continuous at 0, but it does exhibit the intermediate value property 
on [0, 1]. Moreover, Lebesgue proved that there exists a function f : [0,1] > [0,1] that has 
the intermediate value property and is nowhere continuous. 

By the ¢ — 6 definition 3.1, if f is continuous at xo, then around zo there is an “island” 
(xp — 6,49 + 6) such that f(a) does not stray by more than ¢ from f(xo). However, the 6 
measuring the size of the island usually depends on both ¢€ and ao, In the other words, the 
6 is not necessarily the same for all xp € D. 


Example 3.8. Consider f(x) = 2? on D=R. 


For any Xo € R, we have 
If (x) — f(xo)| = |x? — #9] = |e + ao] |x — 20). 
If |a — xp| < 1, we have x € (%) — 1,40 +1) and 
|x + xo| < |a| + |2o| < 2|ao| +1. 


Now, let € > 0. If we choose 6 = min{1, €/(2|z9| + 1)}, then |x — xo| < 6 implies 


| f(x) — f(@o)| < (2|xo| + 1) |x — xo] < (2|20| + 1) (5) =e 


It is clear that the response 6 depends on the value of xo. For example, let € = 1; a response 
of 6 = 1/3 is good for xg = 1 but it requires 6 = 1/21 for zo = 10. The function f now 
becomes “less and less” continuous at every point as x gets bigger. Moreover, for any € > 0, 
no matter how small 6 is, if we let x9 = 2e€/6 and x1 = 2€/d + 6/2, we have |x — xo| < 6 
og Xe de) 6 
sa) — feo)] > (F +) 5 =26 

Thus no response 6 fits all 29 values. 

If a single response 0, i.e., a 6 that depends only on € and not on x € D, can be 
chosen, this indicates the function behaves in the same way throughout the entire D. Such 
a strengthened version of continuity is called uniformly continuous on D. 
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FIGURE 3.4 
Uniform continuous. 


Definition 3.7. A function f : D— R is uniformly continuous on D if for every € > 0 
there exists 6 > 0 such that 


\f(z) — f(y)|<¢ whenever z,y € D,|x—y| < 6. 


Remark. In contrast to continuity at a single point x9, uniform continuity is a global property 
concerning a function and a set on which it is defined. It does not pre-specify a domain 
point zo as is the case for continuity. In the uniformly continuous case, x and xo play a 
symmetric role, so we call them x and y in the above definition (see Figure 3.4). 

To better recognize the difference of 6 in the definitions of continuity and uniform con- 
tinuity, we turn to their formulations in terms of quantifiers and logical symbols: 


Continuity : (Varo € D)(Ve > 0)(Ad > 0)[(a € DA |x — xo| < 5) > |f (x) — f(ao)| < 4, 


Uniform continuity : (Ve > 0)(4d > 0)(Vx € D)(Vy € D)[|az — y| < 6 > | f(x) — fly)| < €. 


In the second formulation, the order of quantifiers shows where the 6 depends only on e. As 
always, a good understanding of the use of quantifiers is a benefit to us for rigorous proofs. 
Resembling Theorem 3.1, we can characterize uniform continuity in terms of sequences. 


Theorem 3.6. A function f : D — R is uniformly continuous on D if and only if for 
every SEQUENCE In, Yn € D, 


flan) — f(yn) 20 whenever tp — Yn > 0 asin —- oo. 
Example 3.9. Show that f(x) =sin(1/x) is not uniformly continuous on (0,1). 
Clearly, f is continuous on (0,1). Let 


1 1 


= Oa tape n= 


Qn7° 
We have %p — Yn > 0 as n > oo, but 


f(@n) — Fn) = 1, 


for alln EN. 

By Examples 3.8 and 3.9, we see that there are continuous functions that are not uni- 
formly continuous on R or (a,b). However, when we turn our attention to a bounded closed 
interval, the following astonishing theorem asserts that there is a single response 6 that 
works with every point in the closed interval. 
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Theorem 3.7 (Uniform Continuity Theorem). If f is continuous on [a,b], then f is 
uniformly continuous on [a, b]. 


Proof. We use the sequential characterization and a proof by contradiction. Assume that 
f is not uniformly continuous on [a,b]. Then there is some « > 0 such that for all 6 > 0, 
there exist x, y € [a,b] with 0 < |a — y| < 6 and yet | f(x) — f(y)| > «. In particular, taking 
6 = 1,1/2,1/3,..., we see that for every n € N there exist x, yn € [a,b] such that 


1 
lZn — Yn| < ii but |f(@n) — f(yn)| = €. 
By the Bolzano-Weierstrass theorem, x, has a subsequence 2, such that 
Ln, — Xo € [a, bl. 


Since 


1 
vee = o| < Yn Ln,,| [erate o| < Nk [rag Lol, 


it follows that y,,, > £o as well. The continuity of f now implies that |f(¢n,)— f(Yn,)| 2 0. 
Thus, there is K € N such that 


If (nn) — F(Yn)| < € 


for k > K. This contradicts the hypothesis above. Thus, f must be uniformly continuous 
on [a, 6]. 


To reinforce the importance of the completeness theorems in Chapter 1, we offer two 
more alternative proofs of Theorem 3.7. They are based on the nested interval theorem and 
the Heine-Borel theorem, respectively. 


Proof by the nested interval theorem. Assume that f is not uniformly continuous on |{a, b]. 
Then there is no uniform response 6 to € on [a,b]. Since 


la, b] = [a, (a + b)/2] U [(a + b) /2, BI, 


then on at least one of these half intervals, there is no uniform response (if 6; works for 
the first half interval and 62 works for the second half interval, then min{6,, 462} works for 
[a, b]). By repeating this process, we obtain nested intervals of arbitrarily short length on 
which there is no uniform response to €. 

Let 2 be the point common to all of these nested intervals. We now show that there 
can be no response to €/2 at this point. Thus, f is not continuous at x9, which contradicts 
the assumption. To this end, there is a nested interval of length less than 6/2. Since there 
is no uniform response to € in this nested interval, it must contain an x for which 6/2 is not 
a response to ¢, this means that there is a y with |x — y| < 6/2 for which 


If(z) — fH) 2 € 


But, on the other hand, both x and y now lie within 6 of xo. If 6 is a response to €/2 at xo, 
then we have 
€ 


2 


= €. 


F(x) — Fy) < |F@) — F(@o)| + [F(@o) — FW) < 5 + 


This leads to a contradiction. 
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Proof by the Heine-Borel theorem. Assume that f is continuous on [a,b]. By the definition 
of continuity, for « > 0 and zp € [a,b], there is some 5(ao) such that 


\f(x) — f(xo)| < 5 whenever x € [a,b] and |x — xo| < d(x). 


Then the family 

{(20 — 6(x0)/2, xo + 9(0)/2) tao efa,b] 
forms a open covering of [a,b]. Applying the Heine-Borel theorem, we find that there are 
n € N and 21,%2,...,%n € [a,b] such that UZ_, (a, — 6(a~)/2, 2% + 0(@~)/2) covers [a, b]. 


Let _ f5(a1) d(a2) 5 (an) 
= min { i: 


SP ag 
For any x,y € [a,b] with |x — y| < 6, there is some m,1 < m < n such that y € (am — 
0(&m)/2,Lm + O(Lm)/2). Hence |y — tm| < 6(@m)/2. By the definition of 6, we also have 
|x — y| < 6(a%m)/2. This implies that 

d(@m) , O(&m) 


2 1 9 


|z —2m| < |e —y|+|y-2m| < = (am). 


In view of the choice of 6(a), we have 
€ € 
(@)— Fem) <$ and |f(y) ~ Flem)l < &. 


Therefore 


IF(@) — F)| S$ LF@) — Flam) + FQ) - Flam) <5 +5 =6 


This shows that f is uniformly continuous on [{a, }]. 


In general, a continuous function does not necessarily map a Cauchy sequence into a 
Cauchy sequence. For example, let 


1 1 
=-— si 0,1). 
fee)=4sin(Z), ee () 
Clearly, the sequence rz, = ~ is Cauchy, but f(a,) = 3 sin(n7/2) is not. However, the 
next theorem show that we have a different story if f is uniformly continuous. 


Theorem 3.8. Let f be uniformly continuous on (a,b). If ap € (a,b) is a Cauchy sequence, 
then so is f(a). Moreover, both f(at) =limg5+ f(x) and f(b~) =limg_5,- f(x) exist. 


Proof. Let ¢ > 0. By assumption, there exists a 6 > 0 such that 
\f(x) — f(y)| <¢ whenever z,y € (a,), |x — y| < 6. 
Since x, is a Cauchy sequence, there exists a positive integer N such that 
|tn —2m| <0 whenever m,n>N. 


Thus, we see that 
|f(an) — f(a@m)|<€ whenever m,n > N. 


This proves that f(z,,) is also a Cauchy sequence. 
We now define 


(oo) = lim f(%n) for any sequence an € (a,b) with tn — a. (3.4) 
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To guarantee (3.4) is well-defined, we prove that 


1. If x, € (a,b) and x, > a, then f(x,) converges. 
2. If an, Yn € (a,b) and both converge to a, then both f(a,) and f(yn) converge 
to the same limit. 


Here (1) implies the existence of (3.4) and (2) guarantees its uniqueness, i.e., the limit is 
independent of the choice of sequences. To prove (1), note that x, is Cauchy, so f(a) is 
also Cauchy by the preceding argument. Hence f(x,,) converges. To prove (2), based on the 
choice of sequences £,, and yn, we construct a third sequence z,, by 


{Zn} — {@1, Y1, £2, Y2,°° : sn Uns +}. 


It is clear that z, € (a,b) with z, — a, and so f(z,) converges by (1). Since both f(x,,) 
and f(yn) are subsequences of f(z,), we find that 


lim f(%n) = dim, f(&) = Jim, F (Yn). 


Nn Co 


Similarly, we can show that f(b) exists. 


Consider the following extended function of f(x): 


If f(x) is uniformly continuous on (a,b), then g(#) is uniformly continuous on [a,b] by 
Theorem 3.7. 

The proofs of the above three fundamental theorems all rely upon the completeness the- 
orems of the real numbers. In closing this section, we point out that these three fundamental 
theorems are logically equivalent to the completeness theorems of the real numbers. In par- 
ticular, we show that all three theorems are equivalent to the least-upper-bound property. 
To see this, we partition R in sprit of Dedekind cuts, which divides the number line into a 
left-set and a right-set. We first set the stage by converting the least-upper-bound property 
into a more intuitively convincing version. 


Definition 3.8 (The Cut Principle). Suppose A and B are nonempty disjoint subsets 
of R whose union is all of R, and every element of A is less than every element of B. 
Then there exists a number c € R, which is called a cut point for A and B, such that every 
xe€ A,x<c, and everyxe Bix >c. 


We then show that 


Theorem 3.9. The cut principle is equivalent to the least-upper-bound property. 


Proof. “=>” Let the set S C R be nonempty and bounded above. Define 


B={beER: bis an upper bound of S} 40, A=R\BFO. 


Let c € R be the cut point for A and B. We show that the c indeed is the least-upper-bound 
of S. In fact, assume first that c € A, i.e., cis not an upper bound for S. Then there exists an 
s € S such that c < s. Let a = (c+ s)/2. The fact that a < s implies that a is not an upper 
bound for S, thus a € A. But a > c, together with the fact that c is a cut point, implies 
that a € B. That’s impossible. Thus, c € B and c is an upper bound for S. Moreover, for 
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any € > 0, c—e < c yields that c—¢ € A, which means that c—€ is not an upper bound for 
S. This proves that c is the least upper bound for S. 

“<=” Let A,B be a cut. The least-upper-bound property implies that c = sup(A) exists. 
We show that c is the cut point for A, B. For any « € A, we immediately get x < c = sup(A). 
For any y € B, if y < c, appealing to the definition of supremum, there is a’ € A such that 
y <a’ <c. This contradicts the definition of the cut. Thus y > c, which completes the 
proof. 


The following corollary gives us one implication on the cut when the Cut principle fails. 
Corollary 3.4. If the cut principle is not satisfied, then there exists a cut of open sets. 


Proof. Suppose there exists a cut for A and B that does not possess a cut point. We now 
show that both sets A and B are open. Here, we show that A is open only, the argument 
for B is similar. Assume that c € A, then (—oo,c] C A. If there is no x € A such that 
x >c, then x < ¢ for all x € A and c < 6 for all b € B since c € A. This implies that c is 
a cut point. The contradiction implies that there must be an a € A such that a > c. Thus, 
[c,a] C A and so c € (~~, a) C A, which shows that A is open. 


Thus, if the cut principle does not hold, let A, B be a cut of open set. Clearly, if f,g : 
R — R are continuous, then the function 


f(z), 2EA, 
F(e)={ g(x), «EB 


is also continuous on R. 

Theorem 3.9 indicates that the cut principle is a completeness property. Thus, to prove 
that each of the three fundamental theorems indeed is a completeness property, it suffices 
to show that it implies the cut principle. We proceed by contrapositive. Based on Corollary 
4, the proof will be accomplished by a suitable choice of functions f and g such that F 
provides a counterexample for each theorem. Here we give the proofs for the extreme value 
theorem and the intermediate value theorem. We leave the proof of the uniform continuous 
theorem to the reader. 

The extreme value theorem does not hold, if the cut principle is not satisfied. 
Let 


_ f a, ze Ana, Dd], 
He) x € BN (a, }}. 


By Corollary 4, F' is continuous on [a,b]. We claim that F does not achieve its maximum 
on [a,b]. To see this, assume there is c € [a,6] such that F(c) = maxzejay) f(x). Since 
F(a) =x >a>a-1= F(y) for all  € AN [a,b] and y € BN [a,}], it follows that 
c € Bf [a,b]. Thus, c € AN [a,b]. However, since A is open, there exists a c’ € AN [a,)] 
such that c’ > c. This implies that F'(c’) = c' > c = F(c), a contradiction. 

The intermediate value theorem does not hold, if the cut principle is not satis- 
fied. Let 


_ fj 0, «€ ANf[a,O), 
Fe) ={ 1, «€ BN {a, b). 


By Corollary 4, F is continuous on [a,b]. Clearly, F' violates the conclusion of the interme- 
diate value property. Thus, in addition to the six theorems in Chapter 1, each of these three 
theorems could well be used to “axiomatize” the completeness of the real numbers. 
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3.4 From the Intermediate Value Theorem to Chaos 


Life is the twofold internal movement of composition and decomposition at once general 
and continuous. — Henri de Blainville 


Let f : [a,b] — [a,b] be a continuous function. In Section 1.3.7, we studied additional 
conditions that ensure the orbit of a € [a, b] 


converges to a fixed point of f. A natural generalization of the fixed point is the periodic 
point. 


Definition 3.9. Letn € N. A point x € [a,b] is called a periodic point of f with period n if 
L"(@) =H 5") F «, fork = 1,2,...,n—1, 
where f” is the nth iteration of f. 


Observe that, if x is a periodic point of f with period n, then the orbit of x is an infinite 

repetition of the pattern 
FOS ect), 

Geometrically, the point of period 1 is a fixed point of f and so lies on the diagonal line 
y = x. Assume that a has period 2. Then f(a) = 6, f(b) = a, and a ¥ b. This implies that 
both points (a,b) and (b,a) are on the graph of y = f(x), they are symmetric with respect 
to y = x. However, in contrast to points of period 1 and 2, the points of period 3 or higher 
do not have an obvious geometric interpretation in terms of the graph. For example, let 
(see Figure 3.5) 


x+1/2, 2x € [0,1/2], 
fa) ={ 1 —#), ee 1/221), 


1.0 
0.8 
0.6 
0.4 


0.2 


0.2 0.4 0.6 0.8 1.0 


FIGURE 3.5 
Periodic points of period 3. 
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We have f (0) = 1/2, f?(0) = f(1/2) = 1, f3(0) = f(1) = 0. So f has a point of period 3. 
Does f have a point of period 5? A point of period 7? Clearly, by just looking at Figure 3.5, 
there is no hint of the fact that every positive integer n is the period of some point! In 1975, 
Li and Yorke published an article with a provocative titled “Period three implies chaos” in 
the American Mathematical Monthly [67]. In this paper, solely based on the intermediate 
value theorem, they asserted the following theorem. 


Theorem 3.10. Let f : [a,b] > [a,b] be continuous. If f has a periodic point of period 
three, then f has periodic points of all other periods. 


The proof will be based on the following three elementary facts. The first fact is similar 
to Corollary 2, in which f([a, 6]) C [a, 0]. 

F, Let f be continuous on [a,b]. If [a,b] C f(a, 6]), then f has at least one fixed point 
in [a, b]. 


Proof. By the assumption, there are 71,22 € [a,b] such that 
f(@i)=a<%1, flte)=b> a. 


Let g(x) = f(x) — x. Then g(a1) > 0 and g(x2) < 0. The desired result follows from the 
intermediate value theorem. 


Fy Let f be continuous on [a,b] and let [c,d] C [a,b] such that [c,d] C f([a,b]). Then 
there is a closed interval K C [a,b] satisfying f(i) = [c,d] . 


Proof. The intermediate value theorem implies that there are %|,%2 € [a,b] such that 
f(ai1) =c and f(#2) =d. First, consider the case 71 < x2. Define 


a=sup{s: f(s)=c¢,4, <s <2}, 6G =inf{t,: f(t) =d,a<s< ao}. 


The continuity implies that f(a) = c, f(G) = d. Geometrically, a and 6 are the closest two 
such points with f(a) = c and f(G) = d. Let K = [a, 6]. Notice that f(x) is not equal to 
c or d when « € (a, 3). Thus, for any « € K, f(x) € [c,d], and so f(K) = [c,d]. The case 
“1 > £2 can be proved by applying the above argument to g(x) = f(a+b— 2). 


The technique of studying how certain sequences of sets are mapped into or onto each 
other is often used in studying dynamical systems. For instance, Smale uses this method 
in his famous “horseshoe example” [51] in which he shows how a homeomorphism on the 
plane can have infinitely many periodic points. 

The last fact is a generalized version of the intermediate value theorem. 

F Let f : [a,b] > [a, 6] be continuous, and let Ip, I), In_—1 be closed subintervals of [a, 6]. 
If 

Tea C fk), (k =0,1,...,.n- 2); ine fUn-1); 


then there exists at least one point x9 € Ip such that f"(xo) = xo and f*(ao) € I, for 
k=0,1,...,.n-1. 

In geometry, this means that, mapped successively by f, xo visits [o,),...,Jn—1 in 
order and eventually returns to where it was. 


Proof. Since Ip C f(In-1), by F2 there is a closed interval K,-1 C In—1 such that 
f(Kn-1) = Ip. Similarly, from 


Ky 1°Cdy, te fla 2); 
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there is a closed subinterval K,-2 C In—2 such that f(Ky,-2) = Ky_1. Proceeding in 
this way, we can find K, Cc J, such that f(k,) = K2 where Ky C Jy. Finally there is a 
subinterval Ko C Ip such that f(io) = Ky. In summary, we find that 


f(Ko) Bf (Bo) =f iy = Bayes; 
Pre) = Bea) =f Ga) eH he So 


Now, by F\, there is a point 29 € Ko C Ip such that f" (xo) = zo. It is clear that f*(2o) € 
Ky C Ip for k= 1,2,...,n—1. 


Equipped with Facts F — Fs, now we are ready to prove Li and Yorke’s Theorem 3.10. 


Proof. Let a < 6B < 7 € [a,b], which form an orbit of period three. There are only two 
possibilities: f(a) = 6 and f(a) = y. We take care of the first case: 


fla) =8, f®=% fx) =a. 


The second case can be handled similarly. 

To begin, let J = [a, 6] and K = [6,7]. Since 6,y € f(Z), it follows that K Cc f(J). 
Similarly, in view of the fact of that f(8) = 7, f(y) =a, we have [a,y] =IUK Cc f(K). 

For any given positive integer n, we now show that there exists a point of period n. For 
n= 1, from K Cc f(K) and Fact 1, there is a fixed point of f in K. Next let n = 2. Consider 
two closed intervals Jp = K and J; = I, which meet all the requirements of Fact 2. Thus, 
there is a point 29 € [6,7] such that f(x9) € [a, 8] and f?(x9) = 2. We claim that zo is 
a point of period 2. For otherwise, since [a, 6] [8,7] = {G8}, we must have xp = 8. This 
implies that 6 = f(6) = > 6, a contradiction. 

Now, assume that n > 3. Let 


fo = fh H=lg =-+ = tn-p = K,Ip-1 = TS. 


All the assumptions of Fact 3 are fulfilled. Thus there is a point 7 € K = [8,7] such that 
f"(xo) = Zo. We show that zo is a point of period n. By contradiction, if there isa k ¢ N 
and k <n such that f*(xo) = xo, then f”~1(zxo) will be one of the following numbers: 


xo, f (xo), f?(20), Doe) f"~? (a0) 


that are all in K. Since f"~'(ao) € I as well, it follows that f"~'(ao) € K NI and so 
f"1(a9) = 8. Thus, x9 = f(x) = f(8) = y. Fact 3 implies that 


f(to) = f(y) =aeh=K =[f,4. 


That’s impossible. Thus, Li and Yoke’s theorem is proved. 


Li and Yorke’s theorem is just the beginning of the story. Soon afterward, it was found 
that Li and Yorke’s theorem is only a special case of a remarkable theorem published in 1964 
by the Russian mathematician Sharkovsky. He gave a complete account of which periods 
imply other periods for a continuous function. His theorem can be best stated in terms 
of the following ordering of the positive integers, which is now known as the Sharkovsky 
ordering: 


345474-+-42-342-542-7---4 
2? 3.42? -542?.74-++42* 429 42? 42.41, 
Theorem 3.11 (Sharkovsky Theorem [84]). Let f : [a,b] — [a,b] be continuous and 


let f have a point of period m. If m<n, then f also has a point of period n. Moreover, there 
are functions which have points of period n but no point of period m. 
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FIGURE 3.6 
Period 5 does not imply period 3. 


Despite its strangeness, the Sharkovsky ordering does include all positive integers. The 
number 3 is the “smallest” in this list, so period 3 implies every possible period! Moreover, 
this theorem also says the following: 


e Periodic 5 implies every period except for possibly 3. 
e Period 6 implies all of the even periods. 


e Any function with finitely many periodic points must only have points with periods equal 
to powers of 2. 


The following example (see Figure 3.6) shows that a function can have a point of period 
5 but no point of period 3. Hence the ordering of periods in the Sharkovsky theorem is 
sharp. 

The proof of the Sharkovsky theorem is a more elaborate application of the intermediate 
value theorem. The original proof is quite difficult. A simplified version can be found in [37, 
Section 1.11]. We will show a special case in Example 17 of Section 3.6. 

Even through the Sharkovsky theorem anticipated Li and Yorke’s theorem by 11 years, 
but, it was Li and Yorke’s paper that popularized the concept of chaos. Indeed, in this 
paper, they also showed that if f has a periodic point of period 3, then there exists an 
uncountable set S such that no point in S is periodic and 


(1) For any z,yES,c Fy, 

lim sup |f" (x) — f"(y)| > 0. 
(2) For any z,ye S,cF#y, 

lim inf |f"(x) — f"(y)| = 0. 
(3) For any x € S and any periodic point p, 


lim sup |f”"(x) — f"(p)| > 0. 
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In view of the definitions of limit superior and limit inferior in Section 1.3.5, these results 
indicate that, for any two distinct points x and y in S, there are infinitely many n such 
that f"(a) and f"(y) are as close as you like, but, there are also infinitely many n such 
that |f"(x) — f”(y)| are always positive. In other words, under the successive iteration of 
f, different points of S are sometimes close, sometimes separated, and none of them is 
periodic. Thus, the orbits of points of S behave in a unpredictable fashion. Beginning with 
Li and Yorke, these properties of S above are used to characterize the chaotic phenomena 
in mathematics. 


Definition 3.10. A function f is called chaotic if for every positive integer n, it has a 
point of period n. 


Examples of chaos are common in our everyday world such as the weather and the 
rise and fall of the stock market. Even the quadratic maps (see Example 1.24) can behave 
chaotically when iterated (see [51, Section 3.5]. The mathematical formulation of what 
constitutes chaotic behavior is one of the most important recent advances in mathematics. 

The Sharkovsky theorem reveals a beautiful and deep relation between periodic points 
of a continuous function. It created a new direction for studying the problem. Functions 
have been studied for hundreds of years. It is surprising that Sharkovsky’s relatively simple 
theorem was not found earlier. Part of the reason is that the classical analysis was more 
concentrated on the local properties of functions. For example, continuity, differentiability, 
and integrability are determined by the local behaviors of functions. The uniform continuity 
is one exception, but it can be derived simply from the local properties. Since a function 
can be iterated on [a,b] but may not be iterated on any subinterval of [a, b], it follows that 
the iteration is a global property. Studying the global properties of functions or mappings 
now forms a new branch of mathematics called global analysis, which includes dynamical 
systems, global differential geometry, and the qualitative theory of differential equations. 
Note that the proof of the Sharkovsky theorem is far from advanced mathematics. This 
suggests that people need not have advanced knowledge to make important contributions 
in mathematics. If opportunity doesn’t knock, build a door. 


3.5 Monotone Functions 
The value of a principle is the number of things it will explain. — Ralph Emerson 


We now discuss a class of functions which is distinct from the class of continuous func- 
tions, but shares some similar properties. We begin with the needed terms. 


Definition 3.11. A function f : D> R is increasing if f(x1) < f(w2) whenever x1 < x2 
on D and decreasing if f(a1) > f(a2) whenever 21 < x2 on D. A monotone function on D 
is one that is either increasing or decreasing on D. 


The monotone convergence theorem guarantees that every monotone sequence converges 
if and only if it is bounded. For monotone functions, we now study some special properties 
not possessed by general functions. 

First, we see that a monotone function can have only jump discontinuities. 


Theorem 3.12. Let f be an increasing and bounded function on (a,b). Then for every 
t € (a,b) the one sided limits f(t~) and f(tt) exist, and f(t~) < f(t) < f(t*). If f(t) = 
f(t*), then f is continuous at t. Furthermore, f(at) and f(b~) exist, with f(a) < f(at) 
and f(b~) < f(b). 
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Proof. Let A(t) = {f(x) : « < t}. Then A(t) is nonempty and bounded above by f(t). 
The least-upper-bound property guarantees that sup{A(t)} exists. It follows that for any 
€ > 0, sup A(t) — € is not an upper bound for this set, so that there is some x < t with 
f(ao) > supA—e. If mo < & < t, then 


sup A(t) —€ < f(xo) < f(x) < sup A(t) < sup A(t) + €, 
so that | f(a) — sup A(t)| < «. This means that 


f(t-) = lim f(x) = sup A(t). 


xt 


Similarly, define B(t) = {f(x) : 2 > t}. We have f(t*) = inf B. 


Equipped with this theorem, we next show that the set of discontinuity points of a 
monotone function is countable. 


Theorem 3.13. Let f be an increasing and bounded function on (a,b). Then 
D={«x: «x € (a,b), f ts discontinuous at x} 
is countable. 


Proof. By Theorem 3.12, the fact x € D implies that f(a~) < f(at). Let 


Thus, D = UP, Dy. We show that D,, is finite for all n € N. Let 
{x1,02,---,2h} C Dy 
satisfying a< 21 <a <--+< ay < b. Choose yj, y2,..., YR such that 
a<Yy<%1, Ui <Yi <@i41 @=1,2,...k-—1), te < yp <b. 
Now for each i, f(yi) < f(a; ), f(a) < F(yi+1) and 
f (yess) — Fs) = FP) — F(@;)- 
Thus 


f(b) — flat) = FO) — Fe+1) 


k+1 1 
+7 (f(s) — Fu5-1)) + FH) - F(a") 2 ke. 


Since f(b~) — f(at) > 0 is finite, it is necessary that k < n(f(b~) — f(a*)). Therefore, D, 
is finite for each n. This proves that D is countable as desired. 


The following floor function provides a nice illustration for this theorem. 
Example 3.10. Consider the greatest integer function f(x) = |x|. 


f is increasing and discontinuous at every integer point (see Figure 3.7). 
In general, the intermediate value property is not enough to guarantee continuity. 
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0.5 


-0.5 


FIGURE 3.7 
f(z) = [a]. 


Example 3.11. Let 
fe) ={ x, if x <0, 


a-l1, ifx>0. 
Clearly, f satisfies the intermediate value property, but is discontinuous at x = 0 (see 
Figure 3.8). 
However, the following theorem shows that a monotone function with the intermediate 


value property is continuous, which provides a partial converse to the the intermediate value 
theorem. 


Theorem 3.14. Let f : [a,b] — R be increasing. If f satisfies the intermediate value 
property on [a,b], then f is continuous in [a, b]. 


1.0 


FIGURE 3.8 
A function has the IVP, but not continuous. 
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3.0, 
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2.0 - 


1.5} 


FIGURE 3.9 
A function is one-to-not, but not monotone. 


Proof. We proceed by contradiction. Assume that f is not continuous at xo € (a, 0), a tiny 
change in the proof can treat the end point case. By Theorem 3.9, there is a jump at Zo. 
Without loss of generality, we assume that f(zq ) < f(xo). In this case, if ¢ < xo, then 
f(x) < f(xq), while if ¢ > xo, then f(x) > f(xo). Thus, f(x) cannot attain the values in 
(f (xp ), f(@o)). This contradicts the intermediate value property. 

If you are unsatisfied with the above proof by contradiction, here is one by the «€ — 6 
definition. For any sequence 2, > x € D, we show that f(z,) > f(a), ie, for any € > 0, 
we must find a positive integer N such that 


f(xo) —€ < f(an) < f(xo) +. 


To prove the right-hand-side inequality, if for n, f(an) < f(xo), we just take N = 1. If there 
is 2m With f(am) > f(xo), we set ye = min{ f(xzo) + €/2,%m}. By the intermediate value 
property, there is x, such that f(a.) = ye and x. > Xo. Hence, there is an index N such 
that x, < x, for alln > N and f(x,) < f(ae) < f(ao) +. 


We saw that f((a, 6]) = [c, d] earlier if f is continuous on [a, 6]. In addition, if f is strictly 
increasing on [a,b], then f is one-to-one and so f~'(x) : [c,d] + [a,b] exists. However, a 
one-to-one function need not be monotone. For example, 


Example 3.12. Let 


x/2, fO<ar< 2, 
fiw) =< -a#/24+3, if2<a<4, 
x/2, ifa<a <6. 


Here f : [0,6] — [0,3] is one-to-one, but f is not monotone (see Figure 3.9). 

Notice that f also satisfies the intermediate value property, but it is not continuous 
everywhere on [0,6]. Thus, the continuity of f is necessary to guarantee a one-to-one function 
is monotone. Moreover, 


Theorem 3.15. If f is a continuous, strictly increasing function on [a,b], then f—1 is a 
continuous, strictly increasing function on [c,d] = f([a, 6]). 


Worked Examples 155 


Proof. We assume that yo € (c,d). The end points can be treated similarly. Then f~(yo) € 
(a,b) and so there exists eg > 0 such that (f~'(yo) — €0, f-'(yo) + €0) C (a,b). 
For any 0 < € < €o, there exist yi, y2 € (c,d) such that 


f(y) = f7" (yo) — 6, 7" (ye) = £7" (yo) + - 


Clearly we have y; < yo < yg. Moreover, if yi < y < y2, then 


f(y) < fy) < f7*(y2). 


Thus, 
f7*(yo) —€ < FY) < F" (Yo) +6 
and so |f~'(y) — f~+(yo)| < €. Now, if we choose 6 = min{y2 — yo, yo — y}, then |y— yo| < 6 
implies y; < y < yo and hence |f~!(y) — f~+(yo)| < €. Hence, f~'(y) is continuous at yo. 
We now show that f~!(y) is strictly increasing. Assume that 


yi <y2, t1=f"(y1), te= f7* (yo). 
Then 
yi = f(v1) and yo = f(z2). 


If x; > x2, then y, > y2, a violation of our assumption. If 7; = x2, then it follows that 
Y1 = Y2, again contrary to our assumption. Thus, we must have x71 < 22, ie., f-+(y) is 
strictly increasing. 


3.6 Worked Examples 


Very often in mathematics the crucial problem is to recognize and to discover what are 
the relevant concepts; once this is accomplished the job may be more than half done. 
— Israel Nathan Herstein 


In this section, we continue with some concrete examples of theoretical flavor to illustrate 
the applications of the theorems we just covered and to reinforce the importance of these 
theorems. 


1. Let f : (a,+00) > R be bounded on any finite interval. If 


prove that limg++0. f(#)/x = A. 


I 
> 


Proof. We use the typical “e/3 argument.” Since lim, 4.0 (f(@+1) — f(x)) 
for any € > 0, there exists a positive integer N, > max{0,a} such that 


|f(a@ +1) — f(x) — Al a whenever x > Nj. 


For this selected N,, by assumption, if  € (a, N, + 1), then |f(x)| < M, where 
M is a positive integer. Now choose N > Nj such that 


M _« |(M+1)A|_¢ 
N 3° 
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If « > N, there is an integer n such that « —n € (Ni, Ni + 1]. Thus, 


fo -4 Dino [f(e@-)-f(e@-i-V)+fle-n)_, 
n-1 
| f(e—i)— f(w@-i-1)—-A (a—n)A f(x —ny) 
< > e + 7 + 
2 ape Eee 
Cis es ve 
< 37313 € 


This proves the desired limit. 


2. Let f,g : [a,oo) satisfy 
(a) g(x +T) > g(x) for x > a, where T is a positive constant. 
(b) f and g are bounded on any finite interval in [a, oo). 
(c) limy+o0 g(x) = co. 
Prove that if 


then limz-,0. f(x)/g(x) = A. 


Proof. By the assumption, for any € > 0, there exists a positive integer N > a 
such that 

f(a +T) - fla) 

ge +T) — g(a) 

For any x > N+T, there is k € N such that x = N+k7 +r, whereO0<r<T. 
Notice that s 4 co © k > o. Using the inequality above successively yields 

_ La) = f(e=7) 

g(x) — g(x — T) 


jae e Se =) = f= 27) 
ge —T) — ge — 27) 


A| <e whenever z> WN. 


<A+t+e 


y] 


<Ate, 


g(a — (k= 1)T)—g(e— kT) 4° 
Combining these inequalities gives 
A-e 
< f@)— fle —T) + fle —T) ~ fe 27) + + fle — (VT) ~ fle — kT) 
g(x) — g(x —T) + g(a —T) — g(x — 27) +--+ g(x — (k- 1)T) — g(x — kT) 


<Ate. 


Telescoping the numerator and denominator, respectively, leads to 


f(z) -—f(@—kT) _ f(x)-f(N +r) 
g(a) — g(e@ KT) ~ g(a) g(N+n) <4 7 (3.5) 
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By (a), we have g(x) = g(N+r+kT)>g9(N+r4+(k—-1)T)>--->9(N+4+r). 
Multiplying (3.5) by g(x) — g(N +r) and then dividing by g(a) yields 


AC are ae g(N +1) FE) GINGER) (1 -9N*D 
ay 9 (1 SE) os ay tara (3 wt). } : 
By applying (b) and (c), (3.6) implies that . 
i f(x) e and limin f(z) —e€ 
PORE age and 1 aa ; 


Now, the desired limit follows from the arbitrariness of e. 


Remark. This problem generalizes the Stolz-Cesaro theorem from sequences to 
functions. Let g(x) = x, T = 1. We see that Problem 1 indeed is a special case of 
this result. Later, we will use this result to prove the well-known L’H6pital’s rule. 


Recall that, in Example 1.5, we have proved that a continuous function on [a, }] is 
bounded by using the Heine-Borel theorem. Subsequently, we reprove the inter- 
mediate value theorem and the uniform continuity theorem via the Heine-Borel 
theorem. Once again, when a local property must be extended to |a, b], the Heine- 
Borel theorem meets the challenge! 


3. Use the Heine-Borel theorem to prove that if f is continuous on [a, b] with f(a) - 
f(b) <0, then there is a point c € (a,b) such that f(c) = 0. 


Proof. Assume the contrary: suppose that f has no zero in [a,b]. Thus for every 
point x € [a,b], there exists (x — 6,,% + 6,) in which f(t) has the same sign as 
f(x)’s. The family of open intervals {(2 — 62,2 + dx) }xe[a,s) cover [a, b]. Hence 
by the Heine-Borel theorem, there are finitely many these intervals, say {x; — 
Ox, 0; + 5x, 81, which cover [a,b]. Without loss of generality, assume a € (x1 — 
bx,,01 + 6y,). Here x1 + de, € (Lo — Ox,,%2 + bz,), in which f(t) has same sign 
as f(a). Continuing in this manner, we will reach b € (ty — d2y,0Nn + O2y,). By 
the selection of the intervals, it follows that f(b) has same sign as f(a). This is a 
contradiction! 


4. Use the Heine-Borel theorem to prove the uniform continuity theorem. 


Proof. For any € > 0 and each 2 € [a,b], by the definition of continuity, there is 
some Jz, > 0 such that x € (%o — d25,%0 + dx9) M [a, b] implies 


If(x) — f(@o)| < 5. 


Since the family of open intervals {(%o — 62/2, 70 + 6x5/2)}eoe[a,o] cover [a, b], 
by the Heine-Borel theorem, there are N € N and 2; € [a,b],2 = 1,2,..., N such 
that 


Let 6 = mini<ij<n{6bz,/2}. Suppose that x,y € [a,b] and |x — y| < 6. There 
exists some k € {1,2,...,N} such that y © (x, — 52,/2, 0% + Ox,/2). Hence 
ly — xx| < dz, /2. The definition of 6 implies that |a — y| < 6,,/2. Hence 


Ong 
2 


Orn 
2 


|z — 2%] < |e—yl+ly— 2x] < = Ox, 
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It follows that 


If (e) — FS LF) — Flee) + IF @e) — FOI < 5 +5 =6 


5. Let f be continuous on [a, 6]. Prove that functions 


M(x) = anes (t) and m(x) = pas (t) 


are continuous on [a, }] as well. 


Proof. We only show that M(a) is continuous. The proof for the case of m(x) 
is similar. Since f is continuous on [a,b], the extreme value theorem guarantees 
that M(a) is well-defined and bounded. Clearly, M(x) is also increasing. Thus, 
by Theorem 3.9, its one-sided limits exist. We assume that xo € (a,b). (A few 
tiny changes in the proof are needed for endpoints.) We now show that 


M(aq ) = M(ao) = M(aG). 


Given any € > 0, since f(z) is continuous at xo, there exists a 6 > 0 such that 
|x — %o| < 6 implies that | f(a) — f(ao)| < ¢. In particular, if ro < « < a9 + 6, we 
have 

f(x) < f(to) +e < M(ao) +e. 
On the other hand, if a < x < xo, we have f(x) < M(x) < M(ao) +«. Thus, as 
ro <x <2 +6, we have M(x) < M(xo) +6, and so 


M (ao) < M(x) < M(2o) +. 


It follows that M(x9) = M(a7?). 


To prove that M(x, ) = M(ao), we assume that M(xo) = f(xo). Otherwise, if 
M(ao) = f(x1) for some a < a, < 2, in this case, we have M(x) = M(2) 
for all a, < x < ao. Therefore, M(x) is continuous from the left hand side. 
Similar to the preceding argument, for any given « > 0, there exists a 6 > 0 
such that 7 — 6 < x < 2 implies that f(x) > f(xo) — € = M(ao) — «. Thus, 
M(a) > M(ao) — € and 


M(ao) — 6 < M(a) < M(ao). 


This proves M(xq ) = M(ao) as desired. 


6. Let f : R-R be a continuous function such that 


t(r+ 2) = 20, for any r€ QandneEN. 


Prove that f is constant. 


f(r+2) =s(r+2) = 100, 


by induction, it follows that 


Proof. Since 


f(r+ 2) = Fr), for any r€ Qand m,neEN. 
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Let r = 0, —m/n, respectively. Then 


This implies that f(r) = f(0) for all r € Q. When x € R\ Q, there exists r, € Q 
such that r, — x as n + oo. By the continuity of f, we find that 


f(v) = Jim, f(r») = F(0). 


This concludes the proof. 


7. Let f : R > R be a function satisfying the intermediate value property. If 
E, ={ax: f(x) =r,r € Q} is a closed set, prove that f is continuous. 


Proof. We proceed by contradiction. Assume that f is not continuous at 2 € R. 
Then there exist an € > 0 and a sequence x, — 2g such that 


lf (an) — f(wo)| 2 
For the inequalities 
f(n) 2 f(to) +€ and flan) < f(x) —€, 


at least one of them should be hold for the infinitely many z,,. Without loss of 
generality, we assume that 


f(@n,) < f(wo) —6, (kK =1,2,3,...). 
Then there is an rational number r such that 
F(@nx) <r < f(o), (k= 1253) 29) (3.7) 


By the intermediate value property, there are yx between x,, and xo such that 
f(yx) =r. Since tp, > Xo, the squeeze theorem yields that y, — xp. Moreover, 
xo € E, because E,. is closed. It follows that f(ao) =r, which contradicts (3.7). 


8. Prove that f is uniformly continuous on an interval J if and only if for any 
e>0,2,y €I,x #4 y, there exists a positive integer N such that 


| f(x) — f(y)| < € whenever ee) > N. (3.8) 


Before proceeding to the proof, we restate the definition of the uniformly contin- 
uous in an equivalent form: 


For any € > 0 and x,y € I , there exists a 6 > 0, such that 
Iffz)-f@lze => |z-yl 26 (3.9) 
Similarly, the equivalent form of (3.8) becomes: 


For any € > 0 and z,y € I , there exists an integer N > 0, such that 


yee) sale. = (OM cy, ro 
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Proof. First, we show that (3.8) is sufficient. By its equivalent form (3.10), we 
have 
Ifl@)-fMIy « 


SS ee. 

N — N 

Thus, for any « > 0 and z,y € J, taking 6 = €/N yields (3.9), which shows that 
f is uniformly continuous on J. 


|x —y| = 


We now show that (3.8) is necessary. If f is uniformly continuous on J, in view 
of (3.9), there is a positive integer k > 1 such that 


kb < |x —y| < (K+ 196. 


Without loss of generality, we assume that x < y. Partitioning [x,y] into (k + 1) 
parts with partition points x; yields 


|x; — 2j-1| = oa < é, 
and so 
lf @a) =f @ea)| <<, G@=1,2,...,441). 
wee He) — Hy) |. SEE Ite) — flea e+ De 2 
x)— fly a ui) — f (vii + Le € 
| u-y |< k6 i kd s 6° 


It follows (3.10) with N > 2e/6. 


Let f(x) be continuous on [0,1] and f(0) = f(1). For every positive integer n, 
prove that there exists x € [0,1] such that 


jey= (2+), 


Proof. Define 


F(x) = f(x) —f (2+ -) : (3.11) 
Clearly, F(x) is continuous on [0,1 —1/n]. Notice that 
0 = f(0)— fC) 
= (£00) = flim) Faia) =f) Peet Fh Tiny — FO) 


F(0)+ F(l/n) +---+ FO -1/n). 
Consider the set 
A= {F(0), F(1/n),--- , FU —-1/n)}. 


If 0 € A, then we are done. If 0 ¢ A, then there must be two elements with 
distinct signs. In this case, the intermediate value theorem implies that F(a) has 
a zero on [0,1 — 1/n. 


An alternative proof by contradiction is as follows: 


Assume that F(x) defined by (3.11) has no zero on [0, 1—1/n]. By the intermediate 
value theorem, F'(x) is either entirely positive or negative on [0,1—1/n]. If F(x) > 
0, then f(a) > f(a +1/n) for all x € [0,1 —1/n]. This leads to 


£(0) > fUl/n) > f(2/n) > +--+ > f(n/n) = FA) = FO), 
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which is impossible. Similarly, if F(a) < 0, then it follows that 
£(0) < f(l/n) < f(2/n) < +++ < f(n/n) = F) = F(0), 


which is also impossible. 


It is interesting to see that the gap in the form of 1/n is necessary. For example, 
let 
f(a) = 2% + cos(5r2). 


Clearly, f(0) = f(1) = 1. For each x, we have 


f(x + 2/5) — f(a) = 5. 


This shows that there is no « with the gap 2/5 such that f(a) = f(a + 2/5). 


Let f : RR be a surjective continuous function that takes any value at most 
twice. Prove that f is strictly monotone. 


Proof. Choose a,b € R with a < b and assume that f(a) < f(b). We now show 
that 
f(a) < f(z) < f(0), for alle € [a,). 


To this end, since f is continuous, f({a, b]) is a bounded interval, it follows that 
there exists c,d € [a,b] such that 


flo) < f(z) < f(@), for all x € [a,b]. 


First, we show that f(c) < f(d). Indeed, if f(c) = f(d), then f is constant on 
[a,b], which contradicts the assumption that f takes any value at most twice. 
Therefore, f(c) < f(d). 


Next, we show that f(c) > f(a) and f(d) < f(b). We show the first inequality 
only, as the second inequality follows by similar arguments. By contradiction, 
assume that f(c) < f(a). Then there exists € € R such that f(£) < f(a). Then 
either € < a or € > b. Let us assume that € < a. By the intermediate value 
theorem, it follows that f takes a certain value at least three times on [€,)], a 
contradiction. Along the same lines, we see that € > b is also impossible. This 
shows that f(c) > f(a). Thus, for all x € [a,b], we have f(a) < f(x) < f(b), and 
so f is monotone increasing. Moreover, in view of that f~'(y) has at most two 
elements for all y € R, it implies that f cannot take the same value at different 
points. Therefore, f is strictly increasing. 


Let f(a) be uniformly continuous on [0, +00). For any « > 0 and positive integer 
n, if limpyoo f(x +n) =0, prove that lim,.. f(x) = 0. 


Proof. Since f is uniformly continuous on [0,00), for any given € > 0, there is a 
6 > 0 such that 


|f(x) — f(y)| <e whenever x,y > 0, |x —y| <6. 


On the other hand, since lim,_... f(a +n) = 0 for any x € [0,1], there exists 
a positive integer N,, such that |f(n + x)| < € whenever n > N,. Therefore, for 
t € (x —6,4+6) and n> Nz, we have 


fn +o] <|f(n+t)— fint+a)|+|f(n+2)| < 2€. 
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Continuity 
By the Heine-Borel theorem, there exist 21, 72,...,¢«K € [0,1] such that 
[0, 1] Gc iy (x; a é, it 0). 


Let N = max{Nz,,Nx.,.--, Nz, }. Then for any > N +1, there exists one x; 
satisfying x — [a] € (a; — 6,2; +6) and so 


[f(2)| = |f(l2] + | < 2¢. 


This proves the desired limit. 


Determine all continuous functions f : R — R satisfying f(0) = 1 and 


f(2x) — f(x) =a, forallxeR. 
Solution. Replacing x by x/2 in the given functional equation yields 
F(x) — f(a/2) = 5. 
Repeating this process leads to 
f(x/2"-?) — f(x/2") = a for all n EN. 


Appealing to the telescoping feature, we sum up these equations to get 


f(a) - Hep") = (Stato te) e 


By the continuity and f(0) = 1, taking the limit n — oo, we find that f(x) = 2+1 
is the unique solution. 


Let f : R—R be a continuous periodic function with period T. For any a > 0, 
prove that there exists x € R such that f(x) = f(a + a). In geometry, this 
fact can be viewed as the existence of horizontal chord of length a. 


Proof. For any given a > 0, define 


g(a) = f(a +a) — fle). 


Clearly, g(a) is continuous on [0,7]. By the extreme value theorem, there are 
£1, £2 € [0,T] such that 


f(v1) = min f(x), f(v2)= max, f(x), 


x€(0,T] x€(0,T] 


and so 


Thus, by the intermediate value theorem, there exists an x9 € [0,7] such that 
g(xo) = 0, the desired result follows. 


Here we have seen that a continuous periodic function f has horizontal chords of 
arbitrary lengths. Replacing the above g(x) by f(x+a)—2f(x)+f(«—q), along 
the same lines, we can prove that f has a chord of any length with midpoint on 
the graph of the function. We leave the details to the interested reader. 
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Let f : R-R be continuous and decreasing. Show that the system 
c=fiy), y=f), 2z=fle) 


has a unique solution. 


Proof. By the assumption that f is decreasing, we have 
Jim (f(@) — 2) =—00, | lim (f(a) — x) = 00. 


The intermediate value theorem implies that there is € € R such that f(€)—&€ = 0. 
That is, € is a fixed point of f. Next, we show that € is the only fixed point of f. 
Indeed, suppose £; and &9 are fixed points of f with €; < &). The decreasing of f 
implies that 

= f(G) 2 f(&) =&, 


which is impossible. Now, we see that (€,€,€) is a solution of the system. Let 
(x0, yo, 20) be a solution of the system. Then 


f(F(F(@o))) = F(Fyo)) = F(20) = 20. 


Since f o f o f is continuous and decreasing, the argument above leads to that it 
has a unique fixed point. Thus, x9 = €. This proves that the system has a unique 
solution to = yo = 20 = . 


Let f : R— R be continuous. If there exist two numbers a € R and M > 0 such 
that |f"(a)| < M for all n € N, prove that f has a fixed point. Here f” represents 
the nth iteration of f. 


Proof. We proceed by contradiction. Assume that f has no fixed point. Then 
for any x € R, f(x) — x either positive or negative constantly. Without loss of 
generality, we assume that f(x) > av. Let 21 = a@,%n41 = f(an) for n > 1. 
Since @n41 = f(@n) > Ln, it follows that the sequence x,, is strictly increasing. 
Moreover, 


Gn = f(@n—1) = fP(@n—2) = +++ = f(a) = FP" (a). 


By assumption, we have |z,,| = |f"~'(a)| < _M. The monotone convergence the- 
orem implies that x, converges. Let limy_.. % = Xo. Then 


Lo = Jim tal Jim f(tn) = f( lim In) = f (Xo). 
So 2 is a fixed point of f. This contradicts the assumption at the beginning. 
A direct existence proof can be done as follows. We separate into two cases: 
(i) There is k € N such that f*(a) = f*~1(a). In this case, ro = f*-1(a) is a 
fixed point of f. 
(ii) For any n € N, f"(a) 4 f”~'(a). Without loss of generality, assume that 
f(a) > a. Define 

S={neNn : f(a) < f?-'(a)}. 

If S = §, the sequence f"(a) is monotonic increasing and bounded by 
M. The monotone convergence theorem implies that f”(a) converges. Let 
limp+oo f"(a) = xo. Then 


vo = lim f"(a) = lim f(f"-"(a)) = F(x0); 


n> Co 


which implies that po is a fixed point. 
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If S £9, let k be the smallest integer in S. Then k > 1 and 
FP (a) < FP1(a), FF (@) > FP?) 
Let x, = f*-?(a), 22 = f*-+(a) and F(z) = f(x) — x. Then 
Fai) =f) -21 = f""@) — f° @) > 0, 


F (a2) = f(a2) — x2 = f*(x) — f* (a) <0. 


By the intermediate value theorem, there is x € R such that Fao) = 0, ie., 
f (xo) = Xo, which shows that 29 is a fixed point again. 


16. Let f : [a,b] > [a,b] be continuous. If f satisfies that f(x) = x for all x € [a,b 
and for some n € N, prove that f?(x) = x for all x € [a, }}. 


Proof. If f(x) = f(y), then f"(x) = f"(y), and so x = y. Therefore, f is one-to- 
one. We now show that f is strictly monotone on [a, b]. It suffices to show that if 
r,s,t € [a,b] and r < s <t, then f(s) is between f(r) and f(t). Indeed, suppose 
f(s) is outside this interval, and say f(s) is closer to f(r). By the intermediate 
value property, there is € € (r,t) such that f(r) = f(€), which contradicts that f 
is one-to-one. Therefore, for a < « < y < b the only possibility are either 


fa) < f(a) < fy) < FO) 


or 
fla) > f(a) > Fy) > FO). 


Suppose that f is increasing on [a,b], we show that f(x) = x for all x € [a,b]. In 
fact, if x > f(x), then 


f(a) > fP(a) >--- > fP"(a) > fP(a). 
Thus, « > f(x) = a, which is impossible. On the other hand, if « < f(x), then 
F(a) < fP(a) <++-< f(a) < f"(2), 


so that « < f"(x) = x, which is false again. Thus we must have f(x) = a. If f 
is decreasing on [a,b], then for x,y € [a,b], « < y implies that f(a) > f(y) and 
f?(x) < f?(x). Thus, f? is increasing. Repeating the above argument yields that 
f?(x) =< for all z € [a,b]. 


If f"(2) = a holds only for some x € [a,b] and for some n > 2, the following 
problem asserts that f still has periodic point of period 2. Since that 2 is the 
smallest period other than fixed point in the Sharkovsky ordering, so this problem 
can be view as a simple special case of Sharkovsky theorem. 


17. Let f : [a,b] — [a,b] be continuous. If f satisfies that f(a) = x for some 


x € [0,1] and for some positive integer n > 2. Show that f has a periodic point 
of period 2. 


Proof. Here we show that if f has a periodic point of period n > 2, then f has 
a periodic point that is not fixed point and has period less than n. The desired 
result then follows from a descending induction. 
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Let 71 < 42 <-+-: < &p be the points on an orbit of period n. We consider the 
directed graph with vertices 1,2,...,2— 1 in which vertex 7 is joined to vertex 7 
if and only if f([xi, vi41]) D [v;,v;41]. Each vertex 7 must be joined to at least 
one vertex j # i, otherwise f would have to permute the endpoints of [x;, x;+1], 
which is impossible since these points lie on a periodic orbit for f with least 
period n > 3. 


Starting at the vertex 1, choose an edge that joins 1 to a different vertex. Then we 
join this vertex to a different vertex, and so on. The path can be extended indef- 
initely with each edge joining two different vertices. After at most n — 1 vertices 


it must return to a previously visited vertex. This gives us a loop 71,%2,...,%q 
that passes through at least 2 and at most n — 1 vertices. Set I, = [%i,,%i,,+1] 
for k = 1,...,q. Then f(z) D In41 for k =,....q—1 and f(g) D hh. There is a 


closed subinterval I, C 11, such that f(1{) = Iz. In order to see this, look at the 
intersection of the graph of f with the rectangle I; x Iz. At least one component 
of this intersection must join the top and bottom edges of I, x Ig. The interval 
Ij, is the projection to I, of such a component. 


Since f4(I) = f2-1(f (I{)) = f2' U2) D Lh D Ii, it follows from the intermediate 
value theorem that f? has a fixed point € € Ij. Clearly € is a periodic point for 
f whose period is a factor of q and therefore less than n. We now show that € 
is not a fixed point for f. Since € € Ij C hy, and f(€) € fU{) = Ie, we can 
have € = f(€) only if € € 4. N Ig. But J; and Ig have disjoint interiors and their 
endpoints belong to an orbit with least period n > 1. 


18. (Monthly Problem 11555, 2011). Let f be a continuous real-valued function 
on [0,1] such that hs f(a)dx = 0. Prove that there exists c in the interval (0, 1) 
such that c?f(c) = [> (x + x?) f(x)dz. 


Proof. If f is identically zero, there is nothing to prove. Now, we assume that 
f (2) is not identically zero. Since ie f(x)dx = 0, there are a,b € [0,1],a 4 b such 
that 
= > 0, b = i < 0. 
Tay nee oe) Ta) aie ee) 
Let 


Fa) =27A(a) — [e+ Ps eat 


It is clear that F(x) is continues on [0, 1]. Moreover, 


Fa) > sla) f+ 2)slayat = (5 —$) fa) >0, 
b 
F(b) < vio | (t +t?) f(b)dt = 0? (5 - 3) f(b) <0 


The intermediate value theorem implies that there is a number c € (a,b) C (0,1) 
such that F(c) = 0, which is equivalent to c? f(c) = fj («+ 2?) f(x)da. 


19. Let f : [0,1] > R bea strictly monotonic and continuous function such that 


‘ f(t)dt =1. 
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Prove there exist a, 3,7 € (0,1) with a < 8 < ¥ such that 


fla) f(A)Fy) = 1. 


Proof. Notice that 


[ riyar= f fl—-ddt=1. 


Without loss of generality, we assume that f is strictly increasing. Since 
fo f(t) dt = 1 and f is continues on [0,1], there exists 0 < t; < 1 such that 


m= aan fe\=fO< fi) =1<MS ee f(x) = f(1). 


Let d = max{m,1/M}. For any 0 < 6 < 1—d, we have 
<i A, Ae : <M 
m - — 

, 1-6 


By the intermediate value theorem, there are 0 < a < t; and ty < y < 1 such 


that ; 
f(a) =1-d, IC) = 4 — 


Thus, letting 6 = t; yields 0 <<a<6<y<1and 


Fla) f(A) Fy) = (1—d)- 17a = 1. 


This result can be generalized to any positive integer n without imposing the 
strictly monotonic condition. See Exercise 74. 


20. Let f : R — R be continuous. Assume every x € R is an extreme point of f, 
show that f is a constant function. 


Proof. By contradiction, assume that f is not constant, then there are a,,b; € 
R,a; < 6b; such that f(a.) 4 f(bi). Without loss of generality, assume that 
f(a1) < f(b1). Applying the intermediate value theorem yields that there is 
c € (a1, b1) such that 


flar) < fe) = RDELOD < py), 


If bi —c < 45%, let a2 =c and by which satisfies ag = c < by <b; and 
f(a1) < faz) = fle) < f(b2) < f(b1). 
Ifc-—a, < Pe let bg] = c and ag which satisfies ay < ag < c= b2 and 
f(a1) < fla2) < fle) = f(b2) < f(b1) < f(b1). 


No matter which case, we always have [a2,b2] C [a1,bi] and f(az) < f(b2). 
Repeating this process, we get 


[an, bn] Cc [an 15 On 1] Gene [a2, bo] Cc [a1, 61], 
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and 0 < by — Gn < (bi — a1)/2"~1. By the nested interval theorem, there is 
Lo ENE, [Gn, by] such that 


lim a, = lim by, = Zo. 
noo noo 


Notice that f(a) is increasing and f(b,,) is decreasing, it follows that 
f(an) < f(&0) < f(bn): 


Thus, xp is not an extreme point, which contradicts the assumption. 


Another proof is based on the fact that R(f), the range of f, is at most countable. 
This fact can be established as follows: Let 


U,={y¢R: there exists rg such that y = f(a9) = maxXze(ag—1/n,29+1/n) f (2). 


Thus, 
U — Wr4 Un 


contains all relative maximum value of f. Define ¢, : Un + Q by 
on :y = f(o) ar EQN ee 
nm Y= J\ro r a) ye mn)” 


We show that ¢ is bijective. In fact, if d(y1) = 11 = r2 = o(y2), then 
1 és 1 1 Rs 1 
r x r x : 
1 1 on?) Se 2 v2 Dye! 2 on 


1 
—_— << —_— { = 
|v, — @q| < Jay — 11] + |rg — val < ba Ga ae 


Since 


by the extreme property, we have f(z) < f(#2) and f(x2) < f(a). Thus, 
yi = f(a1) = f(xe) = yo. So Uy, is at most countable and therefore U is at most 
countable. Similarly, we can show that all relative minimum value of f is also at 
most countable. In summary, R(f) is at most countable. Now, we show f must be 
a constant. If R(f) contains at least two elements, say 71 < rg. The intermediate 
value theorem implies that [r1,r2] C R(f), so R(f) is uncountable since [r1,r2 
is uncountable. The contradiction shows that f is a constant function. 


3.7 Exercises 


Do not watt to strike till the iron is hot; but make it hot by striking. 
— William Butler Yeats 


1. For x € [0,co), define 


f(x) = 


py ifa=p/q,p,EN, gcd(p,q) =1, 
0, if x = 0 or « is irrational. 


Classify the type of discontinuities of f(z). 
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2. (Arnold). Find 

i sin(tan x) — tan(sin x) 
im 

«+0 arcsin(arctan x) — arctan(arcsin x) 


3. Let a1,d2,...,@, be real numbers. Find 


lim 1 — cos(a,2) cos(agx) - +: Cos(dn a) 


x—0 ye? 


4. Let |x| < 1. Find 


1 ate n\” 
im (24 ania ty. 


noo n 
5. Let a1, a2,...,@n be positive real numbers. Prove that 
(a) limy++400 E V(x ay) (a a2) (© = an) | = aitag tan 
ce, ¢, , ¢\1/x 
(b) limy-40 (eee) = /a,a2°* Gn. 
6. Show that 


lim nsin(27en!) = 27. 
n—->co 


7. Let a,b,c be positive. Find the condition for which 
; (“ wy *) 7 
lim {| ——— 
@—>00 Cc 


8. Let f : (a,+00) > R be a bounded function on any finite interval. Prove that 


im x)/* = lim fo tet) 1) 


exists. 


, where f(z) >c>0, 


provides that the right hand side limit exists. 
9. (Putnam Problem 2021-A2). For every positive real number 2, let 


g(x) = lim((a + 1)"** — 2 tyr 
r—0 


Find lim, 4.0 &@. 


10. (Putnam Problem 1998-B1). Find the minimum value of 
(x + 1/x)® — (a® + 1/2) — 2 
(x + 1/x)? + (23 + 1/23) 


for x > 0. 


11. (Putnam Problem 1986-B4). For a positive real number r, let G(r) be the 
minimum value of |r — Vm? + 2n?| for all integers m and n. Prove or disprove 
the assertion that lim,... G(r) exists and equals 0. 


12. Let f(x) : R > [0,+00) be a function which is bounded on [0,1] and 


fle@t+y) Sf(a)fy), for all x,y ER. 


Show that lim, ,45. f(x)!/* exists and is finite. 
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13. Let f : (a,+co) > R be bounded on any finite interval. If 


14. 


15. 


16. 


17. 


18. 


19. 


ee (atl) fe) 


@t—++00 bg 


prove that 
f(x) A 


lim = 


astoo gMtl n+] 


Let g : (0,00) > (0, co) be a continuous function such that 


lim = + 
zoo gitr 


If f : R > (0,co) is twice-differentiable and for some xo € R, 
f" (a) + f'(x) > ag(f(x)), for all z > xz and some a > 0, 


show that lim,... f(x) exists, and find the limit. 


Let f : R- R be a function satisfying 
(a) limg++oo f(x) = 9, 
(b) limy 44. LY-f62) = 9 for a € (0,1). 


Show that limz.4.. f(x)/x = 0. 


=o for some A > 0. 
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(Putnam Problem 1964-B3). Let f(z) be continuous on (0,+00). For any 


a> 0, if limp. f(na) = 0, prove that lim, .. f(x) = 0. 


Let n € N. Define 


Find 


Let f : [0,co) > R be a function such that 


f(ajef™ =a for all x € (0,00). 


Prove that 


(a) f is monotone. 
(b) limg-+oo f(a) = 00. 
(¢) litt 2 =, 


Let f be a function satisfying f(a) > 2/2 and 


f'(e)-Inf(z)=2 for alla > $ (1+1n2). 


f(x) 


(a) Find lim, ... “= 


, if the limit exists. 


(b) Find a € R such that 07°, n°(f(n) — /n) converges. 


(c) Find limp... “4@=-* if the limit exists. 
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20. 


21. 


22. 


23. 


24. 


25. 


26. 


Continuity 


(Putnam Problem 2012-A3). Let f : [—1,1] — R be a continuous function 
such that 
(a) f(x) = cee (==) for every x € [—1, 1], 
(b) f@) =f), a 
f(a) 


(c) limy-51- ia exists and is finite. 


Prove that f is unique, and express f(a) in closed form. 
(Putnam Problem 2013-B3). Let C = UN_,Cwy, where Cy denotes the set of 
those “cosine polynomials” of the form 


N 


f(a) =1+ S- An, cos(27nx) 


n=1 
for which 


(a) f(x) > 0 for every real x, and 
(b) ay =0 whenever n is a multiple of 3. 
Determine the maximum value of f(0) as f ranges through C, and prove that this 


maximum is attained. 


(Putnam Problem 2021-A6). For a positive integer N, let fy be the function 
defined by 


N 
fn(2) = d ati sin((2n + 1)z). 


Determine the smallest constant M such that f(x) < M for all N and for all 
real x. 


Let f : (0,+00) + (0,+00) be increasing satisfying lim,.4.. f(2r)/f(x) = 
For any a > 0, show that 
f(ax) 


Let A,, C [0,1] be a finite element set for every n € N and A; A; = 0 for all 
i,7 €N,i# 7. Define 


faye i if x € An; 
“7 0, if x € [0,1] but not in any A, 


For each a € [0,1], find lim,_,, f(x). 
Let f,g : R-R be periodic functions such that 


lim (f(x) — g(x) =0. 


xL—->Co 


Show that f = g. 
Let f : RR be differentiable at x = 0 with f(0) = 0. For n EN, prove that 


tig, =D Fle/B) = (0) Hn, 


where H,, is the nth harmonic number. 
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27. 


28. 


29. 


30. 


31. 


32. 


33. 


34. 


35. 


36. 


37. 
38. 


Let f : [0,1] > R be continuous. Prove that 


n 


1 
lim — S>(-1)' f(k/n) =0. 
k=1 
Let f : [0,co) > R be continuous such that lim, .. f(x) = L. Show that 
1 


lim f(na) dx = L. 


n—->oco 0 


Let 


= asin (+), O0<a<l, 
fe={ 5 xr=0. 


Show that f(a) is uniformly continuous but not Lipschitz continuous on [0, 1]. 
You may prove a stronger result: 


f(z) — FMI 
jz — yl* 
is bounded for x, y € [0,1] if and only if a < 1/2. 


Let f be well-defined on [a, b]. If lim,_,,, f(x) exists for every zp € [a,b], show 
that f is bounded on |a, }] if only if limz-,2, f(x) is finite for all wo € [a, B]. 


Let f : R —- R attain rational at irrational points and irrational at rational 
points. Prove that f is not continuous. 


Suppose that f : R—- R is superlinear. i.e., if 


Let 


Show that g is well-defined and also superlinear. 


Prove that there is no function defined on R such that it is continuous at rationals 

and discontinuous at irrationals. 

Let f be continuous on R. Assume that lim,,.. f(a) exists and finite, show that 
2 

f attains either maximum or minimum on R. Consider f(«) = rite Show 


that maxzer f(z) = 1+ 2V3/3 and infer f(x) = 0, which is not achievable. 
Let f be continuous on [a,b] with a unique critical point xo € (a,b). Prove that 
if zg is a relative minimum (maximum) point, then f indeed attains absolute 
minimum (maximum) at Zo. 

Let f be an increasing function on [a,b]. If f(0) > 0, f(1) < 1, prove that there 
exists a 2 € (0,1) such that f(a) = x2. 

Is there a function defined on R that satisfies f(f(x)) = e7*? 


Let f be continuous on [a, b]. Let M and m be the maximum and minimum of f 
on [a,b], respectively. Show that, for any constant c, 


max 
x€ [a,b] 


f(x) - 


< max |f(x) — cl. 


2 x€ [a,b] 


aoe 
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39. 


AO. 


Al. 


42. 


43. 


4A. 


45. 


46. 


A7. 


48. 


49. 


50. 


Continuity 


(Chebyshev). Let p(x) any polynomial of degree n with leading coefficient 1. 
Show that 


IV 


ee leer 


Let f,g : [0,1] > [0,1] be continuous functions such that 


a f(z) = nee g(x). 


Show that there exists c € [0,1] such that f?(c) + 10e/) = g?(c) + 10e9). 
= 


Let f : R—> R be a continuous function such that f(f(x)) = 
Prove that there exists a 7 € R such that f(x9) = 20. 


For \ > 0, let 


for all z € R. 


x 
Vaz +r 

Find a formula for nth iteration of f(x). Hint: Consider two cases: \ = 1 and 
AF 1. 

Prove that if f : [a,b] — [a,b] is increasing, then f has a fixed point. Find a 
decreasing function f : [a,b] > [a,b] which has no fixed point. 


f(@) = 


Let f,g : [a,b] — [a,b] be continuous functions. If there exists a sequence 2» € 
(a, 6] such that 

g(@n) = I (ena); for all n € N, 
show that f(x) = g(xo) for some zo € [a, BJ. 
Let f,g : [0,1] — [0,1] be continuous and f(g(x)) = g(f(x)) for all x € [0,1]. 
Prove that 
(a) If f is decreasing, there exists a unique a € [0,1] such that f(a) = g(a) =a, 
(b) If f is monotone, there exists a a € [0,1] such that f(a) = g(a) =a, 
(c) If f is increasing, is the value a for which satisfies f(a) = g(a) = a unique? 


Assume that f satisfies f(a?) = f(a) for all x € R. If f is continuous at 0 and 1, 
prove that f is constant. 


Let f : R-R be a continuous function such that 
f(a) = f(@+1)=f(w4+2r), forallveR. 


Prove that f is constant. 


Let f : RR be a one-to-one continuous function. If f has a fixed point and 
satisfies 
f(Q¢—-f(«#))=a, forallxeR, 
show that f(x) =a. 
Define f : [1,5] — [1,5] by 


with f linear between these integers. Show that f(a) has no periodic point of 
period 3. 

If f : [0,1] > [0,1] is continuous, f(0) = 0, f(1) = 1 and f(f(«#)) = = for all 
x € [0,1], show that f(x) =<. 
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51. Let f be continuous on |a, }]. If for every x € [a.b], there exists at € [a,b] satisfying 


Ol < 5 1F@)l 


show that there is a c € [a,b] such that f(c) = 0. 
52. Let f : [0,1] > R satisfying 


(a) f(0) > 0, f(1) <9, 
(b) there exists a continuous function g such that f + g is monotone increasing 
on [0, 1]. 
Show that f(c) = 0 for some c € (0,1). 
53. Let f : [0,1] > [0,1] be continuous. Show that the graph of y = f(x) intersects 
with both straight lines y = x and y=1—- 2. 
54. Let f be continuous and bounded on [a,oo). Prove that, for every a € R, there 
exists a sequence £, — oo such that 
lim (f(a+2%n) — f(@n)) = 0. 


n—->oco 
55. Let f be uniformly continuous on R. Prove that there exist nonnegative constants 


a and b such that 
|f(x)| < ala|+, for alla ER. 


56. Construct a function f : R — R which is continuous and bounded, but it is not 
uniformly continuous. 

57. Let f : D— R be uniformly continuous. Prove that if D is bounded, then f is 
bounded. This assertion indicates that a uniformly continuous function becomes 
unbounded only if its domain is unbounded. 

58. Let f be continuous on [a,b] with f(a) = f(b). Prove that there exists a xo € 
[a, (a + b)/2] such that f(ao) = f(xo + (a + b)/2). 

59. Let n EN. If f is continuous on [0,n] with f(0) = f(n), prove that there exist n 
distinct pairs (a, y) such that |” — y| € N and f(x) = f(y). 

60. Let f : [0,1] — [0,1] be a function such that |f(a) — f(y)| < |x — y| for all 
x,y € [0,1]. Prove that the set of all fixed points of f is either a single point or 
an interval. 

61. Let a, M €R be positive. If f : [a,co) > R satisfies | f(x) — f(y)| < M|x—y| for 
all x,y € [a, co), prove that f(x)/x is uniformly continuous on [a, 00). 

62. Let f be continuous on [a,b]. For every 21,%2,...,%n € [a,b] and positive 
Ay, A2,--+;An with 07_, Ax = 1, prove that there exists a c € [a,b] such that 


Flo) = 0 Ax f(x). 
k=1 


63. Let f : R—R be continuous that maps open intervals to open intervals. Prove 
that f is monotone. 


64. Let f : R-R bea function that attains neither its maximum nor its minimum 
on any open intervals. 
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65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 


Continuity 


(a) Prove that if f is continuous then f is monotone. 


(b) Give an example of non-monotone function which satisfies the above property. 
(Riesz Rising Sun Lemma). Let f : [a,b] > R be a continuous function. Let 
S = {x € [a,b]; there exists y > x such that f(y) > f(x)}. 


Define E = SN (a,b). Show that E = U(ag, by) such that f(a,) = f (b,x), unless 
a, =a € S for some k, in which case f(a) < f(b,) for that one &. Furthermore, 
ifx@e (ax, be), then f(z) < f (bg). 


Remark. The name of this lemma derives from the following: the sun is rising 
from the right in a mountainous region seen in a one-dimensional profile from the 
side. The elevation at x is f(a), and elements of F are those x values that remain 
in shadow at the instant the sun rises over the horizon as seen from. 


Let a1, 42,a3 > 0 and b, < bo < b3. Show that the equation 


ay a2 a3 
T T 


=0 


x— by x — be x — bg 


has exactly one solution in (b1, 62) and (bg, bs), respectively. 


Let Cn(x) = S79 an coska with a; ER (1 <i <n) and P77 |ax| < an. Prove 
that C,,(x) has at least 2n zeros in (0, 27). 


For each n € N, define T,,(%) = cos(narccos x) for x € [—1, 1]. 


(a) Show that T;,(z) is an algebraic polynomial of degree n. 

(b) Find the roots of T,,(x) on [—1,1] and the points where |T,,(x)| attends its 
maximum value. 

(c) Show that among all polynomials P,,(a) of degree n whose leading coefficient 
is 1 the polynomial T,,(x) is the unique polynomial closest to zero. 


Let f : S' > R be a continuous map, where S! is the unit circle: {(x,y) : 
x? + y”? = 1}. Prove that there exists a pair of (x,y) € St such that f(x,y) = 
ge, aay: 

Remark. This is the special case of the Borsuk-Ulam Theorem: For every continu- 
ous map f : S” > R”, there exists « € S” such that f(x) = f(—«). In general, the 
points x and —z on the sphere are called antipodal points. A nice interpretation 
of this theorem is as follows: Suppose each point on the earth maps continuously 
to a temperature-barometric pressure pair. Then there are two antipodal points 
on the earth with the same temperature and barometric pressure. 


Let 21,¥2,...,%n € [0,1]. Prove that there exists a xo € [0,1] such that 
1S 1 
ra yl vo — xi| = = 2 
ue 4=1 
Let f be continuous on [a, a+ 26] with b > 0. Show that there exists xo € [a,a+] 


such that 


1 
Fao +b) ~ f(00) = 5 (F(a-+ 28) ~ f(a). 
Suppose that ao,a1,...,@n € R and x € (0,1) satisfying 
ao ay gt tel an z. 
cou ee ' Jagr e 
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74. 


79. 


76. 


77. 


78. 


79. 


80. 


81. 


Prove that the equation 
ao tary + aay? +--+ any” =0 


has one solution in (0, 1). 


Let f be a positive function on [a, b]. Define 


re) = piyars jot 


Show that F(a) has a unique zero on {a, }]. 


Let f : [0,1] — R continuous and fo f(x)dx = 1. For any positive integer n, 
prove that there exist distinct t),t2,...,tn € (0,1) such that 


I] f@® =1. 
k=1 


Let f : [0,1] — R continuous and if. f(x)dx = 1. For any positive integer n, 
prove that there exist distinct t),to,...,tn € (0,1) such that 


(a) Upar f(te) = 1 

n fe aes 
(b) Va Fg = 1 
Let f and g be continuous on [a,b]. If f is monotone and there exists a sequence 
Ln, € [a,b] such that g(a) = f(an+1), prove that there exists a € € [a, b] satisfying 
g(€) = f(€). Can we drop the assumption of monotone on f? 
Let f(x) = 4(a@ — 1/2)?, x € [0,1]. Show that for any positive integer n, f"(zx) 
has at least one fixed point. 


Prove that there is no continuous function f : R— R such that, for each c € R, 
the equation f(x) = c has exactly two solutions. How about exactly 3 solutions? 


Define the Cantor set 
co 


Ca{zePjlee=)_ a where a, = 0 or 2.} 


n=1 


Show that C' is the complement of the union of disjoint open intervals I,, n € N 
whose lengths add to 1. Hint: Use the geometric construction of C' by repeated 
removing the middle open third from each previous intervals. Show that 


an gun ae: (ORD BRED 
C= 0,4] Vor 4 a 


nS 


Define f(a) on the Cantor set Cc [0,1] by 


= bn o oa 
f@a= > wai 400 eS ade oe 
n=1 
where bp, = a,/2. Extend f on [0,1] continuously. 


Construct a function f [0,1] — [0,1] such that f(x) = c has infinitely many 
solutions for every c € (0, 1]. 
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82. 


83. 


84. 


85. 


86. 


87. 


88. 
89. 


90. 


91. 


92. 


93. 


94. 


95. 


Continuity 


Let f : [l,co) > R be a positive continuous function such that for every x € 
[1, 00) holds 


i f(t)dt < f(x). 
Prove that 


x-1l 


9 2 


f(x) = 


Prove that a continuous function f : R— R which maps open sets to open sets 
is a monotone function. 


Find all functions f : R — R has the intermediate value property and f"(a) = 
—x for some n € N, where f” is the nth iteration of f. 


(Lebesgue). There exists a function f : [0,1] — [0,1] that has the intermediate 
value property and is discontinuous at every point. 


Let f : R — R be monotone increasing with f(—oo) = 0 and f(co) = 1. Define 
a function g(x) on (0,1) by 


g(x) =inf{t : f(t) >a}. 


Prove that g(x) = g(a*), i-e., g is continuous from the right. 

Let f : R— R be a continuous periodic function with period 1. Prove that 
(a) f is bounded and achieves its maximum and minimum, 

(b) f is uniformly continuous on R, and 

(c) there exists 7p € R such that f(vo + 7) = f(ao). 

If f : R—R takes every value exactly twice, show that f is not continuous. 


A function f is said to be upper semicontinuous at xo if given € > 0, there exists 
a 6 > 0 such that if |a — xo| < 6,, then f(x) < f(ao) + €. Prove that an upper 
semicontinuous function f on [a,b] is bounded above and achieves its maximum 
on [a,b]. Give an example for which an upper semicontinuous function does not 
satisfy the intermediate value property. 

Let f : [0,1] — [0,1] be a continuous function. Define the iteration sequence 
xo € [0,1], an41 = f(en) and A = {x0, 11, v2,...}. Prove that if A is a closed set 
then A has only finitely many elements. 


Prove that there exists no function f : (0,-+co) > (0,+00) such that 
fP(a) = fle +y)(f(x) +y) for all x,y € (0, +00). 


Let 1 < a < b and m,n © R with m ¥ O. Find all continuous function f : 
[0,co) + R such that for x > 0, f(a™) + f(b") = ma tn. 


Prove that there exists no continuous function f : [0,1] + R such that 


f(z) + f(x?) =a for all x € [0,1]. 


Let f : [0,1] — [0,1] be an increasing function. Prove that there exists an 
x € [0,1] such that f(x) =a. Find a decreasing function f : [0,1] > [0,1] which 
has no fixed point. 

Find all continuous functions f : R— R such that f(x) — f(y) is rational for all 
reals x and y such that x — y is rational. 


Exercises 177 


96. Let f : R- R bea surjective continuous function that takes any value at most 
twice. Prove that f is strictly monotone. 


97. Let f be a function from [a,b] into [a,b]. Let S C [a,b] be the set of all periodic 
point of f with period n. Prove that if S has exactly n elements and n > 1, then 
there is no function g : [a,b] — [a,b] such that g” = f. 


98. (Monthly Problem 10818, 2000). Let g : R — R be a continues function 
such that lim, +. (g(#) — #) = co and such that the set {x : g(x) = 2} is finite 
and nonempty. Prove that if f : R— R be continues and fog = f, then f is 
constant. 


99. (Monthly Problem 11872, 2015). Let f be a continuous function from (0, 1] 
into R such that fo f(x)dz = 0. Prove that for all positive integers n there exists 
c € (0,1) such that 


nf x” f(x)dx = c"*" f(c). 
100. Let k be a real number. Find all continuous functions f : R— R such that 
flet+ty)=f(a)+fy)+kay, x,y eR. 
101. Find all continuous functions f : R— R such that 
fle+y)+fla—y) =2f(a)fy), for allz,y ER. 
102. Let n be a positive integer. Find all continuous functions f such that 
fle+y") = f@)+(fy))", — for all a,y € R. 


103. (Putnam Problem 1971-B2). Let f(x) be a real function defined on R except 
x =0 and x = 1 and satisfying the functional equation 


f(x) 4 s(=*)=1 + 2. 


Find all functions f(a) satisfying these conditions. 


104. (Putnam Problem 1988-A5). Prove there exists a unique function f : Rt > 
Rt such that 


f(f(@)) = 6a — f(x) 
and f(x) > 0 for all x > 0. 


105. Let f(x) be a real function defined on R \ {—3,—1,0,1,3} and satisfying the 
functional equation 


fa) +s (42%) =ar+b 


for some given constants a and b. Find all functions f(x) satisfying these condi- 
tions. 


106. (Putnam Problem 1990-B5). Is there an infinitely sequence ao, a1, a2,... of 
nonzero real numbers such that for n = 1,2,3,... the polynomial 


P, (x) = ag +4," +--+ + aya” 


has exactly n distinct real roots? 
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107. 


108. 


109. 


110. 


Continuity 


(Putnam Problem 1996-A6). Let c > 0 be a constant. Given a complete 
description, with proof, of the set of all continuous function f : R — R such that 
f(z) = f(z* +0) forallzeR. 


(Putnam Problem 2014-B6). Let f : [0,1] > R be a function for which there 
is a constant K > 0 such that |f(x)— f(y)| < K|x—y| for all x, y € [0,1]. Suppose 
also that for each rational number r € [0, 1], there exist integers a and b such that 
f(r) =a+or. Prove that there are finitely many intervals 1, Io,...,I, such that 
f is a linear function on each J; and [0,1] = UL, i. 


Define f : [0,1] > [0,1] by 


fl ) = 0.0a;0a20a3 ey ife= 0.aya2a3 Sn 
i os ee ife=1. 
Here x = O.a,a2a3--- is the decimal representation of 2. When the non- 


uniqueness happens, choose the finite representation (for example, if « = 0.1 = 
0.0999---, use x = 0.1). Study the continuity of f(z). 


Let f : [a,b] > R be continuous on [a,b] and differentiable on (a,b). Suppose 
that f has infinitely many zeros, but there is no x € (a,b) with f(x) = f’(x) =0. 


(a) Prove that either f(a) or f(b) equals zero. 
(b) Given an example of such function on [0, 1]. 


A 


Differentiation 


The calculus was the first achievement of modern mathematics, and it is difficult to 
overestimate its importance. 
— John von Neumann 


A hundred years ago such a function would have been considered an outrage on common 
sense. 
— Henri Poincaré on Weierstrass’s nowhere differentiable continuous function 


The notion of the derivative comes from the intuitive concepts of velocity and the slope 
of the tangent line. It is the main theme of differential calculus—one of the major discoveries 
in mathematics. In this chapter we give a rigorous treatment of differentiation and related 
concepts based on limits. First, we focus on two fundamental theorems of derivatives. The 
first proves that a derivative has an intermediate value property. The second is the mean 
value theorem which plays a central role in analysis. As an application of the mean value 
theorem, we present L’H6pital’s rule, which provides us with a powerful tool to compute 
limits of some indeterminate forms. Next, we study some basic properties of convex functions 
including Jensen’s inequality which offers an effective approach to establish inequalities. 
Finally, we extend the mean value theorem to the Taylor theorem, which is considered to 
be the pinnacle of the differential calculus. As usual, we conclude this chapter with some 
interesting problems. 


4.1 Derivatives 


And I dare say that this is not only the most useful and most general problem in geometry 
that I know, but even that I ever desired to know. 
— René Descartes on the calculation of the angles between two curves 


The concept of derivative has been originated from various practical problems. We begin 
with the following formal definition: 


Definition 4.1. Let f : I> R, where I is an interval in R. For any xo € I, we say that 
f is differentiable at xo if the limit 


him £0) = F(z0) 


LX wv — XO 


:= f'(x0) (4.1) 


exists. The limit f'(xo) ts called the derivative of f at xo. 


The geometric motivation for the derivative reveals the impetus behind the definition 
(4.1). Here the difference (f(x) — f(ao))/(a — xo) is the slope of the chord through two 
points (a, f(x)) and (xo, f(ao)). Taking the limit as x approaches 29 yields the slope of the 
tangent line at « = 2. 
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Let = 4) +h. Then « > wp => h - O. The definition (4.1) is rephrased as the 


familiar form f( h) — f(xo) 
' i Lo+ — J\%o 
f'(vo) = lm h 


Now we state the basic operation laws of derivatives with which you are all familiar. 


Theorem 4.1. Let f and g be differentiable at x9. Then the differentiation operation is 
closed under the four basic operations. i.e., 


1. (f = 9)'(x0) = f'(@o) + (x0), 
2. (f9)'(xo) = f'(xo)g(wo) + f(x) 9’ (0), 
3. (f/g9)' (xo) = (f"(w0)9(@o) — (x0) 9! (x0))/9? (x0) if g(xo) # 0. 


The last two rules are usually refereed as the product rule and quotient rule, respectively. 


Theorem 4.2 (Chain Rule). Let g be differentiable at xo and f be differentiable at g(xo). 
Then fog is differentiable at xp with 
(f° 9)'(xo) = f'(9(x0)) 9'(20). 


Let f\) denote the kth derivative of f. The product rule can be extended to the higher 
derivatives. 


Theorem 4.3 (Leibniz’s Rule). Suppose that both f and g have nth derivatives. Then 


n 


(1) => (J) wa" 


k=0 


It is well-known that f(x) = |a| is continuous but fails to be differentiable at x = 0. 
Thus, a continuous function is not necessarily differentiable. However, the converse is true, 
i.e., the differentiability implies the continuity. 


Theorem 4.4. If f is differentiable at xo € I, then f is continuous at xo. 


Proof. We show that lim;.2, f(x) = f(xo). To this end, by the algebraic limit theorem 
and Definition 4.1, we have 


as desired. 


Next, observe that there exist functions which are continuous and differentiable every- 
where on R, but the derivatives need not be continuous. 


Example 4.1. Let 


x? sin if x 
roy { gamcins tte 


If x £0, f’(a) = 2asin(1/x) — cos(1/x). So f’(a) exists for all « 4 0. Moreover, by 
Definition (4.1), we have 


f(x) — F(0) 


. ee 
= lim xsin— = 0. 
x0 FW xz—0 x 


Derivatives 181 


FIGURE 4.1 
Graph of f’(x). 


Since lim,_,9 cos(1/x) does not exist, consequently, f’(x) has no limit at z = 0, so f’(a) is 
not continuous at z = 0 (see Figure 4.1). 

It is always necessary to be careful to confirm what appears to be clear from a geometric 
viewpoint. For example, if f’(0) > 0, is it true that there is neighborhood of 0 on which f 
is increasing? Answer is negative! 


Example 4.2. Let 


fenn{ Gaited 

Here f(x) is differentiable everywhere and satisfies f’(0) = 1, but, for x 4 0, f’(z) 
densely oscillates near the origin and f(z) oscillates strongly around the straight line y = x 
(see Figure 4.2). Thus, f is not increasing on any interval near the origin. This phenomenon 
is caused by the fact that f’(a) is discontinuous at x = 0. 


0.1 02 03 04 05 


FIGURE 4.2 
f is not monotone in the neighborhood of f’(xo) 4 0. 
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4.2 Fundamental Theorems of Differentiation 


The truth always turns out to be simpler than you thought. — Richard Feynman 


We have seen that continuous functions enjoy many nice properties (see Section 3.3). In 
this section, we will look at the consequences of differentiability. Equipped with this stronger 
condition, we should expect to gain even richer rewards. We begin with the classical maxima 
and minimum problem. As one learnt in basic calculus course, the derivative of a function 
is directly relevant to determining its maxima and minima. Recall that 


Definition 4.2. f(x) has a local maximum (minimum) at x = xo if there exists 6 > 0 such 
that 
f(z) < (©) f(xo) for all x € (xp — 6,29 + 4). 


The connection between local extrema and derivatives is the following Fermat’s theorem, 
which displays a geometric intuitive fact: a differentiable function attains extrema at a point 
where the graph has a horizontal tangent line. 


Theorem 4.5 (Fermat’s Theorem). Let f : (a,b) > R. If f attains a local maximum 
(or local minimum) at xo € (a,b), and if f'(ao) exists, then f'(xo) = 0. 


Proof. Without loss of generality, we assume that f attains local maximum at x9. Choose 
6 based on Definition 4.2, so that 


ax<x%—-d<a%<at+d<6b. 
If m9 —0 < x < 20, then 


f(x) — flo) 


tL — XO 


> 0. 


Letting x — wo yields f’(ag) > 0. On the other side, if a9 < x < ag + 6, then 


f(x) = f(ao) 


«tL — XO 


<0 


pia) 


which shows that f’(ao) < 0. Therefore, we find that f’(2o) = 0 as desired. 


Recall Definition 3.5, we see that f’(z) in Example 4.1 has an essential discontinuity at 
x = 0. It is interesting to know what about a derivative with a simple jump discontinuity. 
For example, is there a function f(a) such that 


f(a) -{ — if x <0, 


; if x > 0. 


A quick answer may bring to mind the absolute value function |x|. However, |x| is not 
differentiable at x = 0 and so is not differentiable everywhere. As an application of Fermat’s 
theorem, the following surprising theorem due to Darboux tells us that, without sacrificing 
differentiability at any point, there is no function for which its slopes jump from —1 to 1. 
In other words, not every function is a derivative! A function that is a derivative of some 
function must be special. 


Theorem 4.6 (Darboux’s Theorem). Let f be differentiable on [a,b]. Then for any a 
between f’(a) and f'(b), there exists a point c € (a,b) such that f’(c) = a. In other words, 
f'(x) exhibits the intermediate value property. 
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Proof. First, we treat the special case by assuming that f’(a) and f’(b) have opposite 
sign. For example, f’(a) > 0 and f’(b) < 0. Since f(x) is continuous on [a,b], the extreme 
value theorem yields that there exists a c € [a,b] such that f(c) = maxzeja) f(x). By the 
assumption and Definition 4.1, we have that f(x) > f(a) for x € (a,a+61) and f(x) > f(b) 
for x € (b— 62,6), and soa <c< b. It follows that f’(c) = 0 by Fermat’s Theorem. 

Next, by introducing an auxiliary function, we can always transfer the general case to 
the above special case. To this end, for any a between f’(a) and f’(b), Let 


F(x) = f(a)-—az, x € (a,b). 


Clearly, F(x) is differentiable on [a,b] and F’(x) = f’(a) — a. By the assumption of a, 
F’(a) and F’(b) have opposite sign. The preceding argument guarantees that there exists a 
c € (a,b) with F’(c) =0, so f’(c) =a. 


The following proof of Darboux’s theorem is due to Nadler [70]. This elegant proof shows 
systematically and conceptually why the theorem is true. Let D be the set of all values of 
the derivative of f and C be the set of all slopes of chords joining distinct points of the 
graph of f. We now prove that D is an interval. 


Proof. The mean value theorem says that C C D, and the definition of the derivative 
implies that D C C. Thus, it suffices to prove that C is an interval. To this end, we prove 
that any two points of C can be connected by an interval in C. To prove this, fix p,q € C, 


where 
_ f(v1)— flv2) _ _ fxs) — f(aa) 
7 Ty — & — v3 — 4 
with 21 < %,x%3 < #4, and a; € [a,b] (¢ = 1,2,3,4). We define a continuous function 
g : [0,1] >C by 
re f((1 — thai + tas) — f((1 — thre + tag) 
((1 —t)a1 + tag) — ((1 — t)a + tag) 


Geometrically, g is the slope of the chords one obtains by sliding the points (a1, f(x1)) 
and (x2, f(#2)) linearly with respective to the z-axis along the graph of f to the points 
(x3, f(a3)) and (x4, f(x4)). By the intermediate value theorem, g((0,1]) is an interval in C, 
also p = g(0) and gq = g(1), and this concludes the proof. 


Similar to the intermediate value theorem for continuous functions, Darboux’s theorem 
indeed offers us an intermediate value theorem for derivatives. Consequently, we have 


(1) A derivative cannot pose jump discontinuity. Therefore, if f’(x) is monotone on 
(a,b), then f’(a) is continuous on (a, b). 
(2) A derivative cannot change sign in an interval without taking the value 0. There- 
fore, for example, if f’(a) > 0 on (a,b), then f is strictly increasing on (a,b). 
The second fact provides us a very useful approach in proving inequalities. We illustrate 
this by two examples. 


Example 4.3. Consider f(x) = x° — ax on [0,00), whereO<a< 1. 


Since 
>0, if0<2<1, 
fi@)=e(e7"-1)=< 0, ife=1, 
<0, ifa>1, 


it follows that f attains the maximum at x = 1, so 


x* —ax < f(1)=1-a for all x € (0,00). (4.2) 
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We now derive some classical inequalities from (4.2). For example, for any positive real 
numbers a and 8, let x = a/b, 8 =1—a. Then (4.2) becomes 


ab? < aa +t Bb, (4.3) 


which is often called as the weighted AM-GM inequality. In particular, when a = 6 = 1/2, 
we obtain the well-known AM-GM inequality 


Vab < — 


Furthermore, let p = 1/a,q = 1/8, where p,q > 1,1/p+1/q = 1. Replacing a and 6 in (4.3) 
by a? and 6%, respectively, yields Young’s inequality 


1 1 
ab < —aP + — bf. (4.4) 
Pp qd 


Substituting a by a, and b by by in (4.4) and summing over 1 < k < n gives 


= andy < i S- ay + ; S- Dp. (4.5) 


By a standard normalized variable approach, applying 


> as bp us 
n 1 3 n 1 
Ope ne OS ee 


in (4.5), we finally obtain the classical Hélder’s inequality 


n n 1/p n 1/q 
kei: k= 1. 


ak 


k=1 


Example 4.4. Let x; (i = 1,2,...,n) be positive real numbers with []i_, vi = 1. For 
0<s<t, prove that 


Proof. We prove that function f(x) = )7>;_, x? is increasing for x > 0. Indeed, we have 


f(x) = S- xe Ina. 
i=1 


In particular, f’(0) = >3_, nz; = n([]j_, 2:) = 0. Clearly, 


n 


FE). = S- x? (Ina;)? > 0. 


i= 


B 


This implies that f’(x) is increasing and f(x) > f’(0) = 0. Hence f itself is increasing for 
x> 0. 


We next turn to the mean value theorem, which is fundamental to the theory of deriva- 
tives. First we treat a special case of the mean value theorem. Geometrically, it provides a 
sufficient condition for the existence of horizontal tangent line. 
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Theorem 4.7 (Rolle’s Theorem). Let f : [a,b] — R. Suppose that 


1. f is continuous on |a, b], 
2. f is differentiable on (a,b), and 
3. f(a) = f(b) =0. 


Then there is a point xo € (a,b) at which 


f' (ao) = 0. 


The popular procedure of proving Rolle’s theorem runs as follows. First the extreme value 
theorem implies that f attains a maximum and a minimum on [a,b]. Then the assumption 
derives that the extreme occurs at an interior. Otherwise, f is a constant function and 
f' (x) = 0 for all x € (a,b). Finally the conclusion follows from Fermat’s theorem. Notice that 
Rolle’s theorem is just another existence theorem. It guarantees the existence of a certain 
number v9 without giving any information about how to find x . Here we subsequently 
give two direct proofs around Fermat’s theorem. Samelson’s proof [83] is based on the 
intermediate value theorem and the nested interval theorem. The point x9 found is not 
necessarily the absolute (or even a relative) extrema. Abian’s proof [1] uses the nested 
interval theorem only. Both proofs are highly constructive in the sense that it can be readily 
computerized and x9 can be computed within any desired degree of accuracy. Moreover, 
Abian’s proof also shows the extreme value theorem constructively without invoking the 
boundedness of f on [a, 6]. 


Samelson’s proof. Let 


Since f(a) = f(b), we have 
F(a) = sa) 4(4$*), ana #(*5*) = 5 (2°) - f0) =-Fo. 


The intermediate value theorem ensures that there exists a; € [a,(a + b)/2] such that 
F(a;) = 0. Let b) = a1 + $(b— a). Then 


een Chee eee 5 a. 


Continuing in this way, we obtain a sequence of nested intervals [an,b,] such that 


1 


F (an) = f (bn) and bp, — an = gn 


(b—a), nEN. 


The nested interval theorem implies that there is a unique number 29 € [a@n,b,| for every n 
and 

lim a, = lim by, = Zo. 

noo noo 


Since f(x) is differentiable at xo, we have 


lina f (bn) — fan) 


n> Co 


= f'(xo): 


n — An 


It follows that f’(ao) = 0 from the difference quotients all vanish. 
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Abian’s proof. Let 


a, + by my, + ay by +m, 
a, = a,b) = b,m, ao iS eg 


Without loss of generality, we assume that f(m) > 0. Define 


f(m2) = max{f(m1), f(p1); fq}. 


Of above three values, if two or more of them attain the maximum, we choose mz the first 
according to the order of m,,p1, qi from left to right. Next, let 


ea ar _ or a1 _ M2 + a2 _ b2 + me 
4 742 — 27 4 »P2 = 2 > 42 2 


ag = m2 — 


and 


f(m3) = max{f(me), f(p2); f(q2)}- 


This process can be repeated as often as we like. Consequently, we obtain a sequence of 
nested intervals [an, bp] with 


OX f(m) < f(me) SS flm,) <*> 
and 
f(mn) 2 flan), f(mn) 2 f(bn): 
Let xo be the unique common point of [an,bn]’s, which is asserted by the nested interval 


theorem. Clearly, xo € [a,b] and 


lim a, = lim 6, = lim m, = Zo. 
noo noo noo 


Since f is continuous, we have 
Jim, fan) = jim fbn) = lim f(mn) = f (xo) 


and 
f(to) > flan), f(to) > f(bn) for alln EN. 


We claim that 2 € (a,b). Indeed, if f(m;) > 0 for some i € N, clearly, f(ao) > 0 and so 
xo € (a,b). On the other hand, if f(m;) = 0 for all i € N, the selection of m,; yields that 
ro = mM} € (a,b). Finally, since 

>0 


P(ao) = Flan) 5 gq Fen) = Feo) 


<0 
LO — Gn bn — Xo 


— >) 


taking n + oo concludes that f’(ao) = 0, as desired. 


In general, if the graph of a differentiable function connects the points (a, f(a)) and 
(b, f(b)), we can find an auxiliary function that enables us to reduce this case to Rolle’s 
Theorem. The precise statement and proof are as follows. 


Theorem 4.8 (Lagrange’s Mean Value Theorem). Let f : [a,b] > R. Suppose 


1. f is continuous on |a, b], 


2. f is differentiable in (a,b). 
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(Xo, F(X0)) 


f(b) - f(a) 


FIGURE 4.3 
The tangent line at x9 is parallel to the secant line. 


Then there is a point x € (a,b) where (see Figure 4.3) 


—a 
Proof. By the point-slope form, the equation of the line through (a, f(a)) and (b, f(b)) is 
given by 
y=T(a) = f(a) + = L9) (9), 


Let g(a) = f(x) — T(x). Observe that g(x) is continuous on [a,b], differentiable on (a, b) 
and satisfies g(a) = g(b) = 0. Applying Rolle’s theorem to g yields that there exists a point 
xo € (a,b) such that 


o'(0) = f'(a0) - L9H) <9, 
Thus b 
f' (xo) = Fat = Fa) 


The mean value theorem has a more general form due to Cauchy. It follows by directly 
applying Lagrange’s mean value theorem to the auxiliary function 


h(x) = (F(0) — F(a))g(@) — (9(b) — g(a) F(@). 


Theorem 4.9 (Cauchy’s Mean Value Theorem). Let f,g : [a,b] > R be continuous 
on [a,b] and differentiable on (a,b). If g'(a) #0 for all x € (a,b), then there exists a point 
xo € (a,b) such that 
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Beside its geometrically plausible assertion, the mean value theorem can be stated as 
many special designations. For example, in Physics, the mean value theorem assures that 
there is a time at which the instantaneous velocity equals the average velocity on [a,b]. In 
general, the mean value theorem is the cornerstone for almost every major theorems related 
to differentiation, we will have many opportunities to apply it in the subsequent sections. 
For example, we will use it to prove L’Ho6pital’s rules, to analyze the behavior of infinite 
series, and to establish the fundamental theorem of calculus. 

The mean value theorem is also rich in applications of differentiation, especially when 
it relates the behavior of f’ to f in an intricate way. Here we comprise some immediately 
consequences from the mean value theorem. The proofs are left to the interested reader. 


1. If f : (a,b) > R is differentiable and f’(x) = 0 for all x € (a,b), then f(z) isa 
constant. 
2. A criterion for the identity. If f,g : (a,b) > R are differentiable and f’(x) = g'(zx) 
for all x € (a, 6), then 
f(x) = g(a) +. 


3. A criterion for selecting maximizers and minimizers. Suppose that f : (a,b) > R 
has a second derivative and f’(x%9) = 0. 


e If f’ (ao) > 0, then zo is a local minimum point of f. 


e If f’ (aq) < 0, then xo is a local maximum point of f. 


4. A criterion for proving inequality. If | f’(a)| < M for all a € (a,b), then 
|f(a) — f(y)| < M|a—y| for all z,y € (a, 0). 


A function satisfies the above inequality is called Lipschitz on (a, b). 


5. If f’ exists and is bounded on some interval J, then f is Lipschitz and uniform 
continues on I. 


Finally, we show that Darboux’s theorem and the mean value theorem turn out also to 
be equivalent to the cut principle (and hence completeness per se). This fact is based on 
the Corollary 4 in Chapter 3. We prove the contrapositive. Recall that If the cut principle 
does not hold, then there exists a cut of open sets A and B. Clearly, if f,g : R — R are 
differentiable, then the function 


_ f f(x), «eA, 
Fe)={ g(x), «EB 


is also differentiable on R. 
For the case of Darboux’s theorem, let 


F(x) is differentiable on [a,b]. However, since F’([a, b]) = {0,1}, the derivative clearly does 
not have the intermediate value property. Therefore, Darboux’s theorem implies the cut 
principle. 

For the case of the mean value theorem, let 


_ f 0, «€ ANf[a,O), 
Fe) ={ 1, ce€Bn{a,d]. 
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Here F is differentiable on (a,b) and satisfies F’(x) = 0. However, 


F(b)— F(a) 1 


b-—a b= 6) 


which violates the conclusion of the mean value theorem. Thus, the mean value theorem 
implies the cut principle. 

The connection between these two fundamental theorems of differentiations and the 
completeness of real numbers may offer a philosophical “explanation” as to why they almost 
seem to be too obvious. After all, the completeness of real numbers itself appears completely 
self-evident. This sheds light on the landscape of mathematical theorems and structures. 


4.3. L’H6pital’s Rules 


When the only tool you own is a hammer, every problem begins to resemble a nail. 
— Abraham Maslow 


In this section, we use Cauchy’s mean value theorem to establish a collection of familiar 
theorems usually called L’Hopital’s rules. They are favorite tools for evaluating the limits 
of indeterminate forms. 


Theorem 4.10 (L’H6pital’s Rule I). Suppose f,g: I > R are differentiable and g' (x) 4 
0 for all a near a. If 
f(a) = 9(a) =0 or lim g(x) = +00 


and 
f(a) _ 
“2a g' (x) ; 
then 
im 262) — 
aa g(x) 


Proof. We begin with the case where f(a) = g(a) = 0. Observe that Cauchy’s mean value 
theorem implies that 


for some Xp between a and x. Therefore, 
f(x) | 7 pe — f(a) 1 = pen 1 
fy |= [Rema 


For any given € > 0, there exists a 6 that works for f’(x)/g'(a). Since xo lies between a and 
oy 


o] 


0 <|a—2xo| < ja-2| <6, 
the same 6 will work for f(x)/g(x). 
Next, Let lim,.. g(x) = +oo. By assumption, for any € > 0, there exists a 6; > 0 such 


that i 
| ga) 


ue 
2 
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for alla <a <a+0 . Next, applying Cauchy’s mean value theorem on [a, a+ 6] yields 


f(x) = f(a+61) _ f" (xo) 


g(x) —gla+1) — g’(a0) 


for some 29 € (x,a+ 61). Our choice of 6; then implies 


e _ f(x) — f(a+61) _€ 
VGN Glare) 2 oe 


for all x € (a,a+ 01). 

To isolate the ratio f(x)/g(x), we multiply (4.7) by (g(%) — g(a + 61))/g(). Since 
limz+a g(x) = +00, there exists a 62 > 0 so that g(a) > g(a+ 01) for all x € (a,a + 52). 
Thus g(a + 61)/g(a) < 1 and 


€ at 61 x) — flat, € (a+ 61) 
(z (0 O eee al s(t )( 0) ). 


It follows that, after some algebraic manipulations, 


€ a 1 € a+ 61 x € 
(i$) (eesti) 49 
(a+ d1)(L + €/2) + flat o1) 
ee a(x) ). 


Since L,¢, and 6; are all fixed, there exists a 63 > 0 such that 


gla + 1)(L — €/2) — fla+oi) - € 


< é 
g(x) ~ 2 
gla + oi)(L + €/2) + flat or) — € 
g(«) 2 
Putting all these inequalities together and choosing 6 = min{0d1, d2, 63} guarantee that 
fl) - 1 <e 
g(a) 


for alla<x<ato. 


Notice that there is no assumption on f in the second case. Similarly, when x — oo, we 
have 


Theorem 4.11 (L’H6pital’s Rule II). Suppose f,g : [a,co) > R are differentiable and 
g(x) £0 for all x € [a, oo). If 


and f(2) 

lim = =, 
then 

lim f(z) =f 
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Proof. Here we give a short proof based on Problem 2 in Section 3.6, which serves as a 
bridge between Stolz-Cesaro theorem and L’H6pital’s rules. To see this, we only need to 
verify the conditions in the Problem 2. Here T = 1. Since g/(a) 4 0, Darboux’s theorem 
implies that g'(x) does not change sign in [a,oo). In view of the fact that limz +. g(a) = 
+oo, we have g’(x) > 0 for x € [a,co) and so g(x +1) > g(x) for all a € [a,co). Since f 
and g are differentiable on [a, co), clearly they are bounded on any finite interval in [a, co). 
Finally, for any x € [a, oo), Cauchy’s mean value theorem gives 


f(w@+1)—f(x) _ fi(e+e) 
g(z+1)—g(z)  g'(z+,)’ 


where 0, € (0,1). Thus, 


7 / 
lim = lim F(z) =D, 
roo g' (x fe aco g'(x) 
and so ' 
eg COED Fe) 5, 
wroo g(x + 1) — g(x) 
By the result of Problem 2 in Section 3.6, we find 
2 te) a Fe@+i)— fe) 
lim ~—~= lim —W——— =I], 
woo g(x) aro0 g(x + 1) — g(a) 


By taking the logarithm, the indeterminate forms of 
‘i i oly 


can be transformed into cases of either 0/0 or co/oo, so that L’Hépital’s rule still can be 
applied. 
There are two comments related to the applicability of L’H6pital’s rules. 


(1) We cannot draw any conclusion about limz+4 f(x)/g(x) if limz+a f’(x)/g' (x) 
does not exist. Indeed, consider f(a”) = «+ sina, g(x) = x + cosa. Clearly, 


f' (2) . 1l+cosz 


etoo g(x) «700 1—sing 
does not exist, but 


f(x) i 1+sina/ax 


roo g(x) «+00 1+cosz/a 


(2) The requirement that g’ is nonzero for x near a is crucial. If g’ has zeros in every 
neighborhood of a, the zeros of g’ may cancel the zeros of f’. In this case, we will 


see that lim,_+, 2 at exists but limz_5¢ £ - does not exists. For example, let 
x sin2x sine 
f(a) =F + 2, g(x) = flee. 
Hence ; ; 
i i = =0 


@—00 g(x) ~—00 (a +2cosx+sinx cos z)esine 


However, lim z_+5, oo = lim,-4o, e~ *"* does not exist. This is due to the fact 


that g/(x) = e™* cos a(f(x) + cosx) has zero in every neighborhood of 00. Con- 
sequently, we are not entitled to apply L’Ho6pital’s rule here. 
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We now end this section by introduce a general method for proving the monotonicity of 
a large class of quotients. Because of the similarity to the hypotheses to those of L’H6pital’s 
rule, we refer to the following theorem as the L’H6pital’s monotone rule. 


Theorem 4.12 (L’H6pital’s Monotone Rule (LMR)). Let f, g : [a,b] > R be contin- 
uous functions that are differentiable on (a,b) with g' £0 on (a,b). If f'/g' is increasing 
(decreasing) on (a,b), then the functions 

fle)-f0) |, fle)- fa) 

LP) TINT and tA 

g(x) — g(®) g(a) — g(a) 
are likewise increasing (decreasing) on (a,b). 

Proof. We may assume that g(x) > 0 and f’()/g'(x) is increasing for all x € (a,b). By 
the Cauchy mean value theorem, for each given x € (a,b) there exists c € (a,x) such that 
f(z) - f@ _ £O — f@) 

al = al ? 
g(z)— gla) g'(e) ~ g'(#) 


and so 
f'(x)(g(x) — 9(@)) — 9’ (x)(f (x) — F(a)) = 0. 


Therefore, 


(43) 3 Sa) _ F(z)(g(e) — g(a) — F'(2)F(@) — Fla) S 9 
g(x) — g(a) (g(x) — g(a))? _ 
This shows that (f(x) — f(a))/(g(a) — g(a)) is increasing on (a,b) as desired. Along the 
same lines, we can show that (f(x) — f(b))/(g(x) — g(6)) is increasing. 


Here we assume that a and 0 are finite. Along the same path, this rule can be extended 
easily to the case where a or 0 is infinity. The LMR first appeared in Gromov’s work for 
volume estimation in differential geometry. Since then, the LMR and its variants have been 
used in approximation theory, quasi-conformal theory, and probability. But, for most of 
readers, the LMR is not as well known as it should be. We illustrate this method by proving 


Wilker’s inequality 
: 2 
s ta 
(=*) + nS, iE es oe 
x 


x 
Proof. The proof is almost algorithmic in nature. Set 
sina)? an x : 
F(x) = (=) aa ) ifx #0, 
2, ifx =0. 
Let f(x) = sin? 2+ artanz, g(x) = x?. Now 


f(z) = 2sinxcosz +zsec*z+tanz 


and , 
x . 
me ) = cos” # — sin? x + sec? x + xtan x sec? x. 
g(x) 
Since 
f(a) ee a 
—~ ) =3tanzsec* (1 — cos’ x) +singz | _——{— — cosz } + 2rtan* rsec* x > 0, 
g" (2) sin x cos* & 


f" (x) /g" (a) is increasing on (0, 7/2). Using the LMR twice and noticing that f(0) = f’(0) = 
g(0) = g'(0) = 0, we deduce that f’(x)/g’(a) and then F(x) = f(x)/g(x) is strictly increas- 
ing on (0,7/2). Wilker’s inequality now follows from F(x) > F(0). 


The interested reader can find more applications of the LMR in [25, Chapter 4]. 
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4.4 Convex Functions 


Nothing is built on stone; all is built in sand. But we must build as if the sand were 
stone. — Jorge Borges 


The convex functions consist of a special class of functions and often appear in many 
contexts in mathematics. Their importance in various fields of analysis is steadily growing. 
In this section, we introduce the basic properties of convex functions and examine the 
connections between the convexity and continuity /differentiability. 


Definition 4.3. Let f : I — R, where I is an interval. f is called convex if for every 
a,b€TI and everya withO<a< 1, 


f(aa+ (1 — a)b) < af(a) + (1 — a) f (0). 


If a < b, for each x € (a,b), we have x = aa+ (1 —a)b with a = (b— 2x)/(b—a) and 
1—a=(x-—a)/(b—a). Thus, the definition can be restated as 


b-2 ra 


fw) < = fla + — 1, (4.8) 


Geometrically, this indicates that the graph of f, between (a, f(a)) and (b, f(b)), lies below 
the chord joining these two points. While outside the interval (a,b), the graph of f lies 
above this chord. A change of notation in (4.8) yields 


Theorem 4.13. If f is conver on I anda<b<celT, then 


b— LR 
f() > —— fla) + -— Ff) forb<a<c (4.9) 
and 
f(a) = aan aaa fora<«a<b. (4.10) 
c—b c—b 


Consequently, we have 
Theorem 4.14. If f is conver on an open interval I, then f is continuous on I. 


Proof. For any b € I, we show that f(b~) = f(b*) = f(b). To this end, choose a,c € I 
with a<b<c. When b < x <, the inequalities (4.9) and (4.10) yield 


b-—2x r-a c-— 2x a—b 


== f(a) + F—* FO) < fe) $ 4 t+ 


from which it follows that f(b) = f(b) from x > b*. Similarly, when a < x < b, we have 


c- 2x x—b cra b-ax 


* f(b) + FS fl) < —* fy + = 


f(a), 


C= C— 


which implies that f(b—) = f(b) from x > b~. This proves that f is continuous at x = b. 
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Remark. The hypothesis that I is open is necessary. For example, the function 


1, ifx=0, 
fe) ={ 0, if0<a<1 


is convex on [0,1], but not continuous. 
We next turn to the connection between the convexity and differentiability. Subtracting 
f(a) and f(b) from both sides of (4.8), respectively, we get inequalities among the difference 


quotients 
f(z) — f(a) < f(b) — f(a) é f(b) — f(z) 


r—a b-a b-ax 


, a<a<d, (4.11) 


which is also known as the three chord lemma. Geometrically, inequalities (4.11) shows that 
the slope of the chord joining (a, f(a)) and (6, f(b)) for a convex function is increased if b 
is increased, or if a is increased. 


Theorem 4.15. Let f be convex on an open interval I. Then for any c € I, both f’(c*) 
and f'(c_) exist. In particular, ifa<c< b, we have 


ik 0 cen op ee a (em ac we Cm 


Proof. Let c € I. For any t,u € I with t<c< u, (4.11) gives 


fO-fM — fw-fO 
c—t = U—Cc , 
so that 
sii Hos NZ inf _—— (4.12) 


Now assume that s,v € I with s<t<c<u<_v, by the left-hand inequality of (4.11), we 


have 
fw—-fO — fr)-fO 
u-c 7 v-e ’ 
so the function 
3 LO =LO 
U-—C 


is increasing on IM (c, co). Hence, 


Het) = tim LO=LO _ ing FO- FO) 


uct U—-C U>c U—C 


exists. Similarly, the right-hand inequality of (4.11) gives 


fl) —fls) — fl — Fie) 
c-s ~— e-t ~ 
so the function 
13 1O=$00 


is increasing on IM (—co,c). Therefore, 


(©) = lim HO ~ Te) =sup fo HO 
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exists. We have seen that f’(c~) < f’(c™) in (4.12). Finally, let a < ¢ < b. For t € (a,c), we 


have 
PA TG) oe FIO AI) 2 are c 
t—a = c—t < fle ) 


f(a") < 


Similarly, for u € (c,b) we get 


This proves that 
FeE<fle)<sfeE <i) 


as desired. 


Appealing to Theorem 3.13, this theorem implies that 


Theorem 4.16. If f is conver on an open interval I, then the set of points where f is not 
differentiable is at most countable. 


Let c € J. For any f’(c~) <m< f'(ct), x € T, we have 


f(a) = f() + mle — ¢). 


Thus, at each point (c, f(c)) on the graph, there exists a straight line passing through that 
point, and lying below the graph of f. Such a line is called a support line of f (see Figure 4.4). 
If f’(c) exist, then m = f’(c) and so there is only one support line. Otherwise, m can 
be any number between f’(c~) and f’(c*). 
Based on this property, we have the following simple tests of convexity on differentiable 
functions. 


FIGURE 4.4 
A convex function has a support line. 
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Theorem 4.17. Let f be convex and differentiable on an open interval I. 


1. f is convex if and only if f(x) > f(a) + f'(a)(a@— a) for any az,a€ I. 


2. If f is twice differentiable, then f is convex if and only if f(x) > 0 for all 
xed. 


Monotonicity and convexity are two basic tools for establishing inequalities. We have 
illustrated the applications of monotonicity in previous section. As an application of con- 
vexity, we now end this section by proving the following master inequality. 


Theorem 4.18 (Jensen’s Inequality). Let f : I > R be a convex function. If all 
x; €1,p; > 0,4 =1,2,...,n with py + pe+---+pn =1, then 


F (pity + pote +++++ Prin) < pif (#1) + pof (#2) +--+ + 2nf (en). (4.13) 


Proof. We prove (4.13) by induction. When n = 2 we see that Jensen’s inequality (4.13) 
is same with the definition of convexity. So the basis for induction is clearly true. For the 
induction step, without loss of generality, we assume that 0 < pyi1 < 1 and rewrite 


n+1 n bs 
oa PiXi = PngiInqi + (1 — Pry) S- —————_ 1}. 
i=1 i=l 1— pnt 


Now, by this expression, the definition of convexity, and the induction hypothesis—all ap- 
plied in that order—we get 


n+1 
f S ns] 
i=l 


IA 


Pntif(@n41) + (1 = pai) (>: —— 7) 


IA 


Prt f(tns1) + (1~ Patt) 9) 7 —F(@s) 


n+1 


=. Ss pif (Z:)- 


This proves (4.13). 


Jensen’s inequality provides straightforward answers to many problems. For example, 
let f(z) = —Inz for x > 0. Since f”(x) = 1/2? > 0, f is convex for x > 0. Let pj = 1/n. 
Jeasen’s inequality gives 


(Sa es 
In 


1 
) < (Ina, + Inag+---+]Ina,). 
n n 
This yields the well-known AM-GM inequality 


Perio aks ia an 


A 0109 Ly 
nm 


However, to treat more challenge problems, we may need to make some deliberate prepa- 
rations. The following Putnam problem provides a nice example for this situation. 


Example 4.5 (Putnam 2003-A2). Let a1,a2,...,@, and by, b2,...,b, be nonnegative 
real numbers. Show that 


(ayaz°-- a," + (byb2+-+ ban” < [(ay + b1) (a2 + bg) +++ (Qn + bower 
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Proof. Ifa; = 0 for some 1 <i < n, the inequality is self-evident. So we assume that a; > 0 


for all 1 <i <n. Set t; = b;/a;. Dividing the given inequality by (a,a2---a,)!/” yields an 
equivalent inequality 
1+ (tite-+:th)/" < (1 +t)" +i) --- +t)”. 
Let t; = e**. Taking the logarithm of both sides gives 
1 n 
In (1 4 AEE?) < — 7 (1 +e%). (4.14) 
at 


In view of this form and Jensen’s inequality, if we choose f(a) = In(1 + e”), then (4.14) is 
equivalent to 


p (Geta 
n 


)< ~(f (21) bf (ea) +o f (Sn)): 


This will follow from Jensen’s inequality if we can verify that f is convex. Indeed, we have 
that f(x) = e?”/(1+ e”)? > 0. Thus, f is convex and Jensen’s inequality concludes the 
desired result. 


4.5 Taylor’s Theorem 


You can see a lot just by looking. — Yogi Berra 


In this section, we present the most important theorem in differential calculus—Taylor’s 
theorem, which is a generalization of the mean value theorem and allows us to approximate 
a differentiable function by the Taylor polynomials. Qualitatively, Taylor’s theorem answers 
the following question: to what extent do the derivatives of a function at a single point 
dictate the behavior of the function at nearby points? It also answers a practical concern: if 
we wish to use Taylor polynomials to actually approximate a function, how much accuracy 
can we assure ourselves in this approximation? 


Definition 4.4. Let f : (a,b) > R be nth differentiable at xo € (a,b). The Taylor polyno- 
mial of f at xo ts given by 


 p) ge 
Ta) S- PO) (eno). (4.15) 
k=0 , 


In particular, if x9 = 0, the Taylor polynomial is called the Maclaurin polynomial. 


For n = 1, we have T\(x) = f(#o) + f’(ao)(a — xo), whose graph is the tangent line to 
f at xo. Applying L’H6pital’s rule yields 


tm J=AE) _» 
xL+>XO L— LO 
Hence 
f(z) = Ty (x) + o(@ — 2p). (4.16) 


In general, we have 
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Theorem 4.19 (Taylor’s Theorem with Peano’s Remainder). Let f be nth differen- 
tiable at x9. Then 
f(x) = Tn(#) + o((a — x0)"), 
where T;,(a) ts given by (4.15). 
Here, as usual, f(a) = o(g(x)) means that lim,-,,, f(x)/g(x) = 0. 

Proof. Let Ry(x) = Ry(f,x) = f(x) — T, (x), which is called the Taylor remainder. It 
suffices to show that 

R,(x) = o((a — x0)”). (4.17) 
We prove (4.17) by induction. The base step n = 1 holds by (4.16). Now, assume that (4.17) 
is true for n = k. When n = k + 1, applying the induction hypothesis to f’(x) yields 

Reai(f,) = Re(f", 2) = o((@ — 20)*). 

Thus, by L’Hopita’s rule, we find that 


¢ Reais, x) ys Ryails, t) -_ 
ns (a —_— xo)k+1 i Pn (k + 1)\(a = xo)* ~ 0; 


which implies that (4.17) holds for n =k +1. 


The condition (4.17) actually characterizes the Taylor polynomial T,,(z) completely. 
Indeed, by induction again, we have the following uniqueness theorem. 


Theorem 4.20. Let f be nth differentiable at xo. If Qn(x) is a polynomial such that 
f(x) — Qn(x) = o((x — xo0)”), then Qn(x) = Tn(x), where T,(ax) is given by (4.15). 


This theorem is very useful for calculating the Taylor polynomial T,,(x). It shows that 
using the formula f)(aq)/k! is not the only way to calculate the coefficients of T,(z). 
In fact, if by any means we can find a polynomial Q of degree < n such that f(x) = 
Q(x) + o((@ — %o)”), then Q(x) must be T,,(x). Observe that if T,,(f,2) and T,,(g,x) are 
nth order Taylor polynomials of f and g, respectively, then 


f(x) -g(@) = Tn(f,2) + o((@ — t0)"))(Tn(g, ) + o((x — 20)")) 
= [the terms of degree < n in T,(f,x)-Tn(g,x)| + o((x — 20)”)). 


Thus, to find the nth degree Taylor polynomial of f(x)g(x), simply multiply the nth Taylor 
polynomials of f and g together, discarding all terms of degree large than n. Here we 
illustrate an application of this fact by determining the Maclaurin polynomials of seca 
without computing (sec x)("). Since sec x is even, let 


where Eo, is called the Euler number. It is well-known that 
= 1 
cos £ = S- (—1)* a2* + o(4?"*1), 
k=0 : 


By the identity seca -cosxz = 1, we have 
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and so 


1 1 4 
Eo - 5 (Ea + Bo)’ + 5 (e+ (;) #2 + £0) ifr 


+(-1) (2n)! (Em ( 9 ) Bana + & ) Banas tere + Fs) gen 4 o(a? Te) = 1. 


Matching the coefficients of «?* for k = 0,1,...,n, we obtain the following recursive formu- 
las: 


4 
Eo =1, Fo + Eo = 0, Bx + (5) Bo + Bo =0) 


2n 


2 


This gives that, for example, the first six Euler numbers are 


2 
En + ( ) Bana (77) Banna to + Bo = 0. 


Eo = 1, Ey =—1, Es = 5,E5 = —61, Ey = 1385, Fy = 50521. 


Hence, 
1 5 61 277 50521 
: ae ar 4 6 8 10 11) 
RRS har tS og mg” ggga” To aposeog” 7 
To establish a more precise quantitative estimate of the remainder, one usually imposes 
slightly stronger conditions on f. The estimates will involve bounds on the derivative f("+)). 
Here we present two remainders that are most often encountered. 


Theorem 4.21 (Cauchy’s Remainder and Lagrange’s Remainder). Let f be (n+1)th 
differentiable on (a,b). For xo € (a,b), let T,(x) be given by (4.15) and 


f(a) = Th(x) + Ry (2). 


Then for each x € (a,b), there is a point c between xp and x such that 


ara) 
R,(x) = (w—c)"(w@—29),  (Cauchy’s Remainder) 
n! 
and Gis 
R(x) = vi (©) (f@—29)"*? (Lagrange’s Remainder) 


(n+ 1)! 


Proof. Motivated by (4.15), we introduce 


nr fl) 
FQ) =F0+ > HO wos, te (an, 
k=1 , 


By the assumption, F'(t) is differentiable on (a,b) and 


B (k+1) (k) 
F(t) = f'(t) i» (Z i (t) (x ie i (a of) : 
Telescoping yields ; 
PW) =F (NFO) 


Since 
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the mean value theorem implies that there exists c between x and x9 such that 


(n+1)(¢ 
Ry(x) = F'(c)(x — 20) = f a ( ie c)"(a — Xo), 
which is precisely Cauchy’s remainder. 
On the other hand, let G(t) = —(a — t)"*'. Applying Cauchy’s mean value theorem 
yields 
Rn(x) Fa)= Fe) FO. Fe) 


(2 —a9)"t! = G(x) — G(ap) G'(ec)—s (n+ 1)!’ 
which implies the claimed Lagrange’s remainder. 


Remark. In addition, if f("+" (x) is continuous, by the fundamental theorem of calculus, 
we find that 


x 1 x 
Ra(a) = F(a) Fla) =f Pjat= 2 f @-9rgr*M(dt, (418) 
xo n. xo 
which gives us another remainder form of Taylor’s theorem—the integral remainder. 
If f has derivatives of all orders, this leads naturally into the notion of the Taylor series. 


Definition 4.5. Let f : (a,b) > R be infinitely differentiable and xo € (a,b). The Taylor 
series generated by f at x = xo 1s 


8 "FU. as (1) (¢ 
FP) (e — zo) = flo) + #20) (a — 20) ++ + Ge — 0)" + 
k=0 ; 


In particular, if x9 = 0, the Taylor series is called the Maclaurin series. 


Based on his remainder, Lagrange once asserted that if f(a) exists for all n € N and 
x, 29 € (a,b), then the Taylor series always converges to f itself, namely, 


OO (k) (sp 
#2) =o I) e — a0) 
k=0 : 


But, in 1823, Cauchy discovered the following counterexample: 


_f eV itz 40 
fe) ={ 0, if =0. 


Here f has derivatives of all orders at x9 = 0 with f‘(0) = 0 for all n € N. Thus, the 
Maclaurin series converges to zero for every x, but converges to f(x) itself only at x = 0. 
A more surprising result was given by Borel: Let a, be any real sequence. Then there are 
infinitely many differentiable function f such that f(")(0) =a, for alln EN. 
Recall that 
f(x) = Tn(#) + Rn(@). 

Thus, the Taylor series generated by f does converge to f itself on (a,b) is equivalent to 
show that 

Jim, R,(x) =0 for all x € (a,b). (4.19) 


In practice, it may be quite difficult to deal with this limit without knowing the value of c 
in either Cauchy’s or Lagrange’s remainder. One popular sufficient condition for (4.19) will 
definitely hold is: there exists a positive constant M such that 


If™ (x)| <M”, for allné€ N,2 € (a,0). 


Another sufficient condition for (4.19) valids is due to Bernstein. 
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Theorem 4.22 (Bernstein Theorem). Let f and all its derivatives be nonnegative on 
[xo, a]. Then, for any x € (x9, a), 


Proof. By a translation we can assume that zo = 0. For any x € (0,a), we show that 


0< Ral) < (2)""" f(a). (4.20) 


a 


This implies that R,(x) + 0 as n > oo since (x/a)"* > 0 for x € (0, a). 
To prove (4.20), we apply the integral remainder (4.18). The change of variable t = 
(1 — u)a with zo = 0 gives 


By the assumption that all derivations are nonnegative, it follows that f("*+ (x) is increasing 
on (0, a]. Thus, 


r 1 
Rn( ) == j u® fF) (1 — u)x)du 


=a f e-em a= BY, 
and so ee 
Rn(z) < (=) ~ Raa). (4.21) 
Recall that fy, ft 
f(x) = Ty(«) + Rn(x) = f 0) a* + Rp(a). 


It follows that R,(a) < f(a) since the terms in T,,(a) are nonnegative. This fact, together 
with (4.21), now proves (4.20) as desired, in turn, it completes the proof. 


4.6 Worked Examples 
The intelligence is proved not by ease of learning, but by understanding what we learn. 
— Joseph Whitney 


1. Prove that Thomae’s function T(x) (see Example 3.3) is nowhere differentiable. 


Proof. Recall that T(x) is discontinuous at every rational point. Thus T(x) is not 
differentiable at every rational point. We now prove that T(x) is not differentiable 
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at every irrational point by contradiction. Assume that T(a) is differentiable at 
xo € R\Q. Then 


T(z) -T 0-0 
(oi=. tm 9. ie =0 
rao, cER\Q xL— Xo r—>29,cER\Q T— Xo 


By the definition of the derivative, for any « € (0,1), there exists a 6 > 0 such 
that 


<e, whenever 0 < |x — 2| < 6. (4.22) 


ze ~T (zo) 
x — 20 


On the other hand, choose g € N such that g > 1/6. Let p = |aoq|. We have 


1 
p<«q<pt+l1 and eee ae 
qd qd qd 
Thus, 0 < x9 — p/q < 1/q < 6, and 
T —T 1 
| (p/q) — T(xo)| _|__ 1/4 is sce 
p/q— Xo to—p/q| oqg—P 


This contradicts (4.22), from which it concludes our proof. 


It is well-known that f’(z) > 0 on (a,b) implies that f is strictly increasing on 
(a,b). Find an example for which f is strictly increasing on (a,b) with f’(x) =0 
infinitely many times. 


Solution. Let 


i@\= { — cos(ing) —sin(ine), ie € (0.1), 


Then f(x) = 2(1 — cos(Inx)) > 0. For any 21,22 € [0,1] with x1 < x2, we have 
x2 
Flea) = Fler) = | s(eydt>0. 
Ty 
This implies that f is strictly increasing on (0, 1). Moreover, we find that f’(x,) = 


0 where x, = e~ 2” € [0, 1] for every n € N. See Figure 4.5 of the function nearby 
2, =e? = 0.0018734.... 


Another proof of Darboux’s theorem. 


Proof. This proof is due to Olsen [74]. Assume that a lies strictly between f’(a) 
and f’(b). Define 


f'(a), ift =a, 
Fa(t) ={ fOQ=-fa) ; 
ta? if t x a. 


and r'(0) ‘ ; 
e) i t a ’ 
Fit) = { fO-fO)) itt Ab. 
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0.010 


0.008 


0.006 


0.004 


0.002 


0.002 0.004 0.006 0.008 0.010 


FIGURE 4.5 
A strictly increasing function with infinitely many zero derivatives. 


Then both F,(t) and F(t) are continuous on [a, b]. Since F,,(b) = F(a), either a 
lies between F(a) and F,,(b), or a lies between F;,(a) and F,(b). In the first case, 
the intermediate value theorem implies that there exists s € (a, b] such that 


F,(s) = f(s) _ F(a) 


S—@a 


C= 


By Lagrange’s mean value theorem, there exists x1 € (a, s) such that 


In the second case, along the same lines, there exist s € [a,b) and x2 € (s,b) such 


that F 


This completes the proof. 


4. Let f be continuously differentiable on [a, b]. If f’(c) = 0 for some c € (a,b), prove 
that there exists 79 € (a,b) such that 


f' (xo) as Peo) — Ha) : 
Proof. Define g : [a,b] + R by 
g(a) = f(a) - FOL) 


If f(c) = f(a), just choosing 2 = c yields f’(c) = 0 = Hei Without 
loss of generality, we assume that f(c) > f(a). Let a1 € (a,c] be such that 
f(a) = max{ f(x); x € [a,c]}. Then 


f (x1) — f(a) > 02 (b- a) f"(x1), 
which implies that g(x1) < 0. 
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On the other hand, by Lagrange’s mean value theorem, there exists x2 € (a, 21) 


such that 
r1)— fla 
f(a) = 1) ae - 
ty a 
Therefore, 


f(1) = fl@) _ flva) = f(a) 


t—-a b-a 


g(x2) = >0> g(r1). 


Using the intermediate value theorem, we find that there exists xo € [#2, 71) such 
that g(vo) = 0. This ends the proof. 


5. Let f be a three times differentiable function such that f has at least four distinct 
real zeros. Prove that f’” (x) + 3af"(x) + 3a? f’(x) +.a° f(x) has at least one zero 
for every aE R. 


Proof. Let F(a) = e** f(a). By the assumption, F(x) has at least four distinct 
real zeros as well. Applying Rolle’s theorem repeatedly yields that F’ (x), F(x) 
and F’”’ (a) have at least 3, 2,1 distinct real zeros, respectively. Since, by Leibniz’s 
rule (Theorem 4.3), 


F(x) = e8(f""(x) + 3af" (x) + 30° f(x) +a° f(x), 


ax 


and e“” is never zero, it follows the desired result. 


6. Suppose that f(0) =0 and f’(0) exists and is finite. Define 
. k 
k=1 
Prove that limp. Un = f’(0)/2. 


Proof. Note that 
Hepa Get MEN INO) 8 ap PG) 
Fey 0 tea ae 


Thus, by definition, for any € > 0, there exists a 6 > 0 such that 


fi) -e< f(z) < f’(0) +¢€ whenever 0<2 <6. 
x 
Choose n € N such that N > 1/6. When n > N, we have k/n? < 1/n < 1/N <6, 


and so 


W'@-9-5<1(S)<v@ro- 4. 


Summing k from 1 to n yields 
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Letting n — oo gets 
1 1 
50) — 6) < Jim, tn < 500) +0). 
Since € is arbitrary, this yields the proposed limit by the squeeze theorem. 


Remark. Letting f(x) = sina and f(x) = In(1+ 2), respectively, we find that 


n 


: “3 k . " k 1/2 
Jim S- sin (=) = 1/2, Jim II (1 + =| —el/2, 
k=1 k=1 
7. Let fn(z) =a" nx with n EN. Find limp oo ff" (1/n)/nl. 


Solution. Observe that 
fig) =ne" ne +a" HS nfpate lt. 
Differentiating both sides n — 1 times yields 
AO (@) = nf7 (@) + (@— DL 
Dividing both sides by n! gives 


FO (a) F@) 1 
7 a et WH 12s tes 


Telescoping these sums yields 


1”) (2) 
n! 


1 1 
=Ing+1+=4+---+-. 

2 n 
Let « = 1/n. In terms of the nth harmonic number H,,, we find that 


(n) 

nm (1 
lim i) = lim (A, —Inn) =), 
noo n! noo 


which is the Euler-Mascheroni constant. 


8. If p(x) is a non-constant polynomial with only real roots, prove that (p’(x))? > 
p(x)p" (x) for all « € R. 


Proof. Let p(a) = a(x — x1)(" — 42) +--+ (a — a). The logarithmic differentiation 


gives 
1 1 1 
/ =< | ft... 2 
va) = te) (> ' 7 — Xo —.) 
When « 4 x; (i = 1,2,...,n), we have 
p(z) 1 1 Ae 1 
pz) £—-2, L—22 L— Ly 


Differentiating this yields 
p"(x)p(x) — (p'(x))? _ ee ee eh ! <0 
p?(«) (w—a1)? © (w@—a2)? © (@— an)? , 
It follows that (p’(x))? > p(x)p"(x) for all x 4 x; (i = 1,2,...,n). Whe 


nx 
x; (i = 1,2,...,n). The proposed inequality has nothing to prove since p(#;) = 
0. 
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Let p(z) be a polynomial with distinct roots a1, a2,...,@, and with the degree 
n > 2. Prove that 


Proof. Let 


n 
p(z) =C J] (z-a8), 
k=1 
where C is a nonzero constant. By partial fraction decomposition, we have 
Bid ie 
p(z) fi Z— OR , 


where 6,(k = 1,2,...,n) is a constant to be determined. To find 6,, appealing 
to 


2: Ohi Bile — an 
(Z Br + ys ee 
Ne. 1<i<n,itk 
then letting z + a, and applying L’Hopital’s rule, we get 
— Ak 1 


z 
= lim — : 
Pagan Bey, eR 


where p’(ax,) # 0 since a, is a single root. Therefore, 


or equivalently 


is: re PW). (4.23) 


Note that, for each k = 1,2,...,n, 


p(z) = ynal S- Q; amcor og eae Bm II Q; 


zZ—Q 
k 1<i<n,i£k 1<i<n,i£k 


Matching the coefficient of z"~! in (4.23), we find that 


Since C 4 0, it follows that 


3 
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10. Let f(x) = (14+ fx)". Find f™(1). 


Solution. Let g(x) = (1 — Vx)?("+). By induction, it is easy to show that 
g (1) = 0. Applying the binomial theorem yields 


2(n+1) a 
Ha) tole) = So (°F) atl8 + aytetn = S 9 (2042) a 
k=0 k=O 


Hence 


(f(x) + g(x))™ = 2 (m1 oe ”) + (n+ 1)tr) =2An+1)\(2n+1+2), 


and so f()(1) =4(n+1)-(n+1)!. 


11. Let n be positive integer and f(x) = sina/ax for x > 0. Prove that 


1 


(n) 
f(a) < 


where f‘”)(x) means the nth derivative of f. 


Proof. We offer two different proofs. The first one is based on the auxiliary func- 
tion defined by 


g(v) =a" G (x) - =) . 


n+1 
Clearly, g(0) = 0 and 


I 


g(x) (n te 1)a” (FG) 2 4) +4 gett pet) 


x" [(n + f(a) + of FY — 1] 
a" [(af)Or (x) — I] 


where Leibniz’s rule is applied in the last equation. Using that 
(xf) (x) = (sin x)" = sin (« + s(n + ) il, 


we find that g’(a) < 0 for all > 0 and consequently g(x) < 0 for x € (0,7/2). 
Hence the desired strict inequality holds. 


The second proof is based on the observation: 


f(s) = Z(f cos(et) dt) 


i _ (cos(axt)) dt 


l| 


1 
= i t” F,,(at) dt, 
0 
where F;,(a) equals one of {+ sin(at), + cos(xt)}. Thus, |F;,(#t)| < 1 and so 
ee 1 1 1 
de < t” | Fy, (at)| dt < t” dt = ——. 
FO @ls frend < f — 
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Let f : [0,1] + R be twice differentiable and satisfy f(0) = 2, f’(0) = —2 and 
f(1) = 1. Prove that there exists a real number c € (0,1) such that f(c)f’(c) + 
f"(0) =0. 


Proof. We introduce the function 


g(2) = 5P(0) + F(a). 


Since g(0) = 0 and 

Gf (x) = f(a): f(a) + f(a), 
by Rolle’s theorem, it suffices to prove that there exists a real number a € (0, 1) 
such that g(@) = 0. To this end, we separate into three cases: 


(1) If f is never zero in (0, 1), let 


1 1 
h(a) = =2@- =. 
= 3° Fe) 
Since h(0) = h(1) = —1/2, it follows that there exists a € (0,1) such that 


h'(a) = 0. Thus, g(a) = f?(a)h’(a) = 0, as desired. 
(2) If f has exact one zero a € (0,1), then f(a) = f’(a) = 0. In this case, clearly, 
g(a) = 0. 
(3) If f has at least two zeros in (0,1), let x1 be the first one and x2 be the last. 
Then 

f(a) > 0 when x € (0,21) U (22, 1]. 


This implies that f’(#1) < 0 and f’(a%2) > 0. Notice that 


g(t1) = f'(a1) <0, g(x2) = f' (x2) = 0. 


By the intermediate value theorem, there is a € [1,2] such that g(a) = 0. 


Let f be differentiable on [a,oo) with f(a) = 0. If |f’(x)| < |f(x)| for all « > a, 
prove that f(x) = 0. 


Proof. Since the differentiability implies the continuity, we see that f is continuous 
on [a,a + 1/2]. By the extreme value theorem, there exists an x € [a,a + 1/2] 
such that 


M= max | |f(a)| =|f(xo)I- 


x€[a,a+1/2] 


Applying the mean value theorem, we deduce that there exists x; € (a,29) such 
that 


M = |f(eo)| = [f(a0) — F@I = IF" (e\(ao - a] $ 5 |F@)]S 5M. 


It follows that M = 0,ie., f(a) = 0 for all x € [a,a+ 1/2]. Along the same lines, 
we can prove that f(x) = 0 for all x € [a+ (n— 1)/2,a4+ n/2],n € N. Therefore, 
f(x) =0 for all x > a. 


Let f be continuous on [0,1] and differentiable in (0,1). Assume that f(0) = 
0,0 < f’(x) < 1. Prove that 


(f 1) i) > [Pear 


Worked Examples 


15. 


Proof. Let 


zr) = (| float) cia) =f f(t) dt 


We need to show that aS ye ns ). By the assumptions that f(0) = 0 and 0 < 
f’(z) <1, we have f(x) = fy f’(t) dt > 0 for x € (0,1). Then G’(x) = f3(x) > 0 
for x € (0,1). By mie $s mean es theorem, there is a cy; € (0,1) such that 


F(t) —F) _ Fe) _ 2Je' fat 
GQ) ~ GQ) -GO ~ Ga) ~~ Pa) 


Since 
25° f(t) dt _ 2 Sy" t) dt —0 


f?(e1) fae £?(0) ° 


applying Cauchy’s mean value theorem again yields 


FQ) 2f5° f(t)dt- 1 


G(1) fia) Fay fica) 


for some cz € (0,c1). Now the desired inequality F'(1) > G(1) follows from the 
assumption that f’(x) < 1. 


Let f be differentiable on [a,b]. Prove that there exists an 29 € [a,b] such that 


=H). 


If (wo) = | 


Proof. Without loss of generality, we assume that [a,b] = [0,1]. Define D = 


|f(1) — f(0)| and 
A = {0,1,2,--+ , 9}. 


First, we claim that there exists at least one number p; € A such that 


f(0.(p1 + 1)) — f(0-p1) 


> D. 
0.(p1 + 1) = 0.p1 


Indeed, otherwise, 
D 
= lf) — FOO) SFL) — $0.9) +++ + 1F(0.1) — F(O)| < 10-5 = D, 
which is impossible. 


Next, let [a1, 61] = [0.p1,0.(p1 + 1)]. We repeat the same argument, there exists 
p2 € A such that 


> D. 


fone p2 +1)) — f(0-pip2) 
0.pi(p2 + 1) — O.pipe 


Let [a2, b2] = [0.pipe, 0.p1(p2 + 1)]. In general, we have 
ae eel 
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where a, = 0.p1po-++ Pn; bn = 0-pip2--: (Pn +1), (n = 1,2,...,). In view of the 
fact that b, — a, = 1/10" > 0 as n + o, by the nested interval theorem, there 
is xo € [an, b»] for all n € N. Now we only need to show that 


f (bn) — fan) 


n — Aan 


= f'(xo). 


lim 
noo 


To this end, let an = (bn — %0)/(bn — an). Then 0 < an < 1. The desired limit 


follows from , 
f( ey sa f (an) _ f' (20) 


= oy (im) = 19) _ 4a) +0 ay) (HA f"(«0)) 


by — Lo an — LO 


and the definition of the derivative of f at xo. 


Remark. This result can be viewed as a weaker version of Lagrange’s mean value 
theorem. The nice ingredient of the argument is bypassing the application of 
Rolle’s theorem. Moreover, the above argument implies that there exist 71, x2 € 
(a, b) such that 


Let f : JR. If f is bounded above on any closed subinterval of J and satisfies 


that 
p(2aey gtev ates 
2 2 


, for any 21,2 €T, 
prove that f is convex on I. 


Proof. By contradiction. Assume that f is not convex on J. By Definition 4.3, 
there exist 71,12 € I,0 < a < 1/2 such that 


f(ar, + (1—a)x2) —af(a1) -—(1-—a)f(az) =L>0. 
Define 
flee) ~ fle) ¢, 


TQ — 21 


F(x) = f(x) — f(x1) £1). 


Clearly, F(x) is also bounded above on any closed interval of I. Moreover, direct 
calculation yields 


F (#1) = F(a) =0, Flav, +(1-—axg))=L>0, 


and i . 
F F 
F as < (a) + OF for a,be I. 
2 2 
Hence 
2b = 2Flar,+(1-—a)zrg] 
_ oF as +(1 pales + £9 


< F[2ax, + (1 — 2a)x2] + F(2x2) 
= F[2ax, + (1 - 2a)x9]. 
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Let ay = 2a. Then Flayx1 + (1 — a1)22] = 22 > 0. If a, < 1/2, we repeat the 
above process. If a, > 1/2, we replace a, by 1— ay, x1 by %2, and x2 by x1, then 
repeat the above precess. Therefore, there exist a1, @2,...,@n, such that 


F(Qn%1 + (1 — ap)a2) = 2°L. 


This will contradict the assumption for which F’ is bounded above. 


17. (Monthly Problem 11369, 2008). Prove that for all real ¢, and all a > 2, 


et 4 ect =) < (e ae e *\e — Qo, 


Proof. First, observe that the proposed inequality is invariant when t is replaced 
by —t. Hence, it suffices to show the inequality holds for t > 0. Next, let x =e’. 
Then the proposed inequality is equivalent to 


(x? +1)% —2?%-1 
1 pd 


To apply the LMR (Theorem 4.12), we choose that f(a) = (a? + 1)% — 2?¢-1 
and g(x) = «*. Then 


ws (4.24) 


f'(2) Qa(a? Ee 1B ae 7 2720-1 
g(@) ae | 


F(a) = a = 2x (: rs oe — 22°. 


To show that f’(x)/g’(x) is increasing for x > 1, it suffices to prove that F’(x) > 0 
for x > 1. Indeed, 


F'(¢) =2 (: ~ lo - sot —2an°", 


Define 


vt 
Using Bernoulli’s inequality 
(1+t)? >1+4pt fort > 0, p> 1, 


which can be proved via the LMR by considering (1 + t)?/(1 + pt) as well, we 


have 
1 a-l 1 a-l 
(2+ =) = tt (1+ =) > ool + (a— Nao ?, 
x av 


Therefore, for x > 1 and a > 2, 


2(a — 1)(a — 2)a°~3 (a? — 1) 
w+ 


Figs > 0. 


Now, the LMR deduces that 
f(a) — f) _ @?+1)* -a@- 241 
g(x) — (1) ze] 
is increasing for z > 1. In particular, applying L’Hopital’s rule yields 
(x? + 1)% — 22% — 2% 41 = 


ee 2 ee A) ee a 
Pe a=) oo 71 aes 
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Thus, 


f(x) — fQ) (x? + 1)% — 27% — 2% +41 \ 
g(a) —9(1 1 ee 


) 
This proves the desired (4.24) and therefore concludes the proposed inequality. 


The following two examples demonstrate that Taylor’s formula is also an instru- 
ment for revealing quantitative information for derivatives. 


Let f be twice differentiable on [0,1] and f(0) = f(1) = 0. Show that if 
minzejo,1) f(x) = —1, then there exist c,,c2 € (0,1) such that 


f(a) 2 8, fea) <8. 


Proof. Let f(%o) = minzejo,1; f(x). By the assumption that f(r) = —1 <0 = 
f(0) = f(1), it follows that 29 € (0,1). Moreover, Fermat’s theorem implies that 
f'(ao) = 0. Applying Taylor’s theorem with Lagrange’s remainder to f(1) and 
f(0) at xo, respectively, we obtain 


FL) = Flo) + F'(e0)(1 ~ 20) + 5 4"(e1) (1 = 40)? 
= Flee) + 5-20)? F"(er) 

F(0) = Feo) + F'(e0)(0- 20) + 54" (c2)(0 ~ 20)? 
= Floo) + 523F"c2) 


where c; € (0,1), c2 € (0,20). In view of f(0) = f(1) = 0, f(a) = —1, we find 
that 


2 2 
” — ae 
f (c1) = (1 — 29)?’ f (c2) ae 
If ao € (0, 1/2], then 1/2 < 1— 2p < 1. In this case, 
2 2 2 2 
Hl: — < => i = >> = oO. 
FON aga (yaya ae = Ge 


If xo € (1/2, 1), then 0 < 1 — x < 1/2. In this case, 


2 2 2 2 


f%\(a) = (l a)! > (1/22 = 8, f" (ce) = ae < (1/22 =8 


Let f(a) be twice differentiable on R. Let My = sup,cr |f(a)|,k = 0,1,2. If 
Mo and Mp are bounded, prove that M? < 2MpMb, so M, is also bounded. 


Proof. First observe that if Mz = 0, then the only bounded functions satisfy- 
ing the hypotheses are the constant functions. So, without loss of generality, we 
assume that M2 > 0. For any fixed h € R, by Taylor’s formula, we have 


1 
f(@+h) = f(a)+f'(a)ht 5f"(ea)h’, where c; is between x and x +h, 


1 
f(@-h) = f(«)—f'(a)ht gf" (e2)h’, where C2 is between x and x — h. 
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Subtracting these two equations yields 


fle +h) — fle h) =2f(a)h-+ SWP(F"(er) ~ Fc). 


That is, ; 
2f'(x)h = fle +h) — f(e—h) — sh°(F"(c1) — f"(e2))- 


Applying the hypothesis gives 
aif" (w)|h < |2f"(w)h| < 2My + Mah. 
It follows that, for any h € R, the trinomial 
Moh? — 2| f’(x)|h + 2Mpo > 0. 


Thus the discriminant b? — 4ac = 4(|f’(ax)|? — 2MpMz2) < 0, which concludes that 
M2 < 2MoMp. 


This result asserts that if f itself is bounded together with its second derivative, 
then the derivative of f is also bounded. Landau and Kolmogorov generalized 
the above inequality to the following interpolation inequalities between different 
derivatives: Let My, = supzce |f (x)|,k =0,1,...,n. Then 

My < 2h —*)/2ygh-k/™ Rin for 1 Sk <n. 


A variant of this kind of inequalities in the Hélder’s spaces are called the Sobolev 
embedding inequalities. 


We now conclude this section with the proof of Stirling’s formula. 


(Stirling’s Formula). Prove that, for sufficiently large n, 


n! = V2rn (=) efn/12n for some 0 < On < 1. 
e 


Proof. First, we find an estimate for Yn!. By the AM-GM inequality, we have 
1\" 1 1 1 
“W(1+—] -1< n{(1+—]+4+1]} =1+ —. 
n n+1 n n+1 


This equivalent to 
1 n 1 n+1 
(1 + =) < (1 + =) ; 
n n+1 


On the other hand, since 


it follows that 
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In summary, we find that 


1 n 1 n+1 
(1 + *) is strictly increasing and (1 + *) is strictly decreasing. 
n n 


Recall that e = limy_,.(1+1/n)”. We find that, for all k € N, 


k k+1 
1 1 
ire (42 ; 
(1+;) <e</( +; 


Multiplying this inequality for k from 1 to n yields 


1)” y)jrrl 
+I" on gol) 
nr nm 


ey a=) 
epee, = = 
e € 


Therefore, by the squeeze theorem, we have 


te 


which is equivalent to 


‘ Vv ni 1 
lim — =-— 
n—-oco nN € 


and so Vn! ~ n/e. To establish an estimate of n! itself, we introduce a, = 
ni(e/n)”. Then 


Ont. _ e = pi-nin(iti/ny — VP +1 i —-(nti/2)mati/n), 
on” G+Ey va 


Since 


1 1 1 
n(1+2) =m (14545) in(1 soa): 


using the Maclaurin series of In(1 + x), we find that 


SE et ad eee ee ce ae ee 
. n) ~\Qn41' 3Qn+13 | 5Qn+1)5 


This yields 


0 < (n1/2)in (1+ *) 1<3 (eam oat )=5(Z-=n): 


—1/12n 


Thus n-!/2q,, is strictly decreasing and n~'/?e dnis strictly increasing. More- 
over, they converge to the same limit, denote this limit as C’. Then 
poe TG @ Oe ais 


and so 
nl = CVn (=) em/12n (9 < Oy <1). (4.25) 


Finally, we determine the value of C. To this end, by (4.25), we have 


= | _ ; 
noo’ (nti n+ Intl Qn)! 2/2 


ia (2n)!! ; Jn (2"n!)? C (4.26) 
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On the other hand, by iteration, we have 


1 44) 
_ 2\n+1/24,, (2n Liar 
i OS EES op ae: 


Since ; ; : 
| (l—@?)"" de < | (hea?) dex | (1—27)"dz, 
0 0 0 


it follows that 
(2n + 2)!! s (2n + 1)! a s (2n)!! 
(Qn+3)!! ~ (Qn+2)!2 ~ (Qn4 1)! 


Multiplying this inequality by \/n and letting n — oo yields 


a V2F C 
Re eae 


Thus, C = V2r, in turn, we obtain Stirling’s formula as desired. 


Remark. Applying Wallis’s formula (2.22) in (4.26) will lead to a shorter proof of 
C= V2r 
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4.7 Exercises 


Be not afraid of going slowly; be afraid only of standing still. — Chinese Proverb 


1. 


Let f be differentiable on (a,b). If f is unbounded, show that f’(x) is also un- 
bounded. Determine whether the converse is also true. 


Let f be differentiable on (a,b). If f’(x) is monotone on (a, b), show that f’(x) is 
continuous on (a, b). 


(Putnam 1986-A1). Find, with explanation, the maximum value of f(x) = 
x — 3x on the set of all real numbers x satisfying «* + 36 < 1327. 


(Putnam 2010-A2). Find all differentiable functions f : R — R such that 
f(a +n) — f(x) 
(OS 
n 
for all real numbers x and all positive integers n. 


(Di Bruno’s Formula). Let g be nth differentiable at a, and let f be nth 
differentiable at b = g(a). Prove that 


cert n (3) 
LEC ae ues 119 (a) 


kG] 


where the summation is over a sequence of nonnegative integers {kj}(j = 
1,2,...,n) satisfying )7_ jkj =n, and k is defined by k = }0"_, kj. For exam- 
ple, for n = 3, we have 


(F(g(@))) (a) = fF (b)9? (a) + 3f"()9/ (a)9"(a) + f'()9 (@). 
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12. 


13. 


14. 


15. 
16. 
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Differentiation 


Let f be differentiable on [0,0o) such that limz_... f(@) _ 9. Prove that 


x 


lim inf | f’(x)| = 0. 


Let f(x) be well-defined on (—1,1) such that f’(0) exists. If the sequences a, and 
by, satisfy 
-l<a,<0<b, <1, lim an = lim b, = 0, 
n—- co noo 
show that : 
lias f(bn) = flan) 


n—-+>Co 


= f"(0). 


nm — Aan 


Suppose that f is continuously differentiable on (—6d,6) for some 6 > 0. If both 
f'(0) and f”(0) exist, prove that 


fn £—F (n+) _ 1 


xz—0 nie 


Let a; > 0 for 1 <i <n. Compute 


Let x,y > 0. Show that x¥+y” > 1. 
For x > 0, show that 


2x 
<In(1 
Ea eros a+ 


i 


Let a1 > a2 >--+ > ay > O and let f’(0) > 0 and f” (x) > 0 for x > 0. Show that 


n 


xe pai (ax) )> 7 (>: a] . 
k=1 k=1 

Let f be continuous on [0,3] and differentiable on (0,3) with f(0) = 1, f(1) = 
2, f(3) =2 

(a) Show that f has at least one fixed point in [0,3]. 

(b) Let a € (0,1). Show that there exists a c € [0,3] such that f’(c) =a. 


Let f : R — [0,00) be twice differentiable with f”(x) < 0. Prove that f is a 
constant. 


Prove that there is no differentiable function f(x) such that f(f(x)) = 2?-32+3. 
Prove that there is no twice differentiable function f : R— R such that 


f(x) > 0, f'(z) > 0, fl’ (x) <0. 


Let p(x) be a polynomial satisfying 


p(x) — p" (x) — p'(x) + p(x) > 0 for alla ER. 


Show that p(x) > 0 for all z ER. 
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18. 


19. 


20. 


21. 


22. 


23. 


24. 
25. 


26. 


27. 


28. 


29. 


Let p(a) be a polynomial with all real zeros x1, 22,...,2%, Show that 
bom 2,/ (p\3 
b 
wp ( f° MHA) ) « [OHO 
a «iP (2) 


p’(a)%p(b)? 
where a <b < min{21,22,..., Un}. 
Let 


= 


ax? +ba +c 
— 0 . 

F(a) an? + Bx +7 ke ) 
Show that if f has three inflection points then these three points stay on the same 
line. 
Let f be third differentiable on [—1,1] with f(0) = f’(0) = f(—1) = 0 and 
f(1) = 1. Show that there exists a c € (—1,1) such that f’(c) > 3 
Let f : RR be twice differentiable with f(0) = 2, f’(0) = —2 and f(1) = 1. 
Show that there exists c € (—1,1) such that f(c)f’(c) + f”(c) =0 
Let f and g be continuously differentiable on [a,b] with f(a) = f(b) = 0. If 


_| f(x) g(x) : 
W(f,g) = | fay g@ | # 0 for each a € {a, 0], 


show that g(a) has zero in (a, b). 

Let f(a) = arctan. Find f(")(0). Hint: f satisfies the differential equation (1 + 
x)y" + 2axy' = 0. 

Let f(a) = -2%,. Show that f((0) € Z for alln EN. 


1+e2" 
Let n € N. Show that, for x > 0, 
d” n! 
Es 5 eye 
dan (V2)! S Gy 


Hint. Find an integral representation for the above nth derivative. See Problem 
11 in Section 4.6. 


Show that the sequence a,, defined by 


( i" 
a, ={1l+-— 
nm 


is decreasing if and only if x > 1/2. 
For n € N, show that 


1 1\" 1 1\" 
1+ 14+- <e<[{1l+—— 1+- : 
2n+1 n 2n n 


(Putnam 2002-B3). Show that, for all integers n > 1, 


(Putnam 2014-A1). Prove that every nonzero coefficient of the Taylor series of 
(l-x+27)e* 


about x = 0 is a rational number whose numerator (in lowest terms) is either 1 
or a prime number. 
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30. 


31. 


32. 
33. 


34. 


35. 


36. 


37. 


38. 


39. 


AO. 


Al. 


Differentiation 
Let f : [0,1] — R be a differentiable function such that there is no x with 
f(x) = f'(x) =0. Prove that the set {x : f(a) = 0} is finite. 


Let f be a differentiable function such that f(#)+/f’(x) < 1 for all x, and f(0) = 0. 
Show that f(x) <1-—e7*. 


Let 4) =a >0,%n4i1 = (n+ 1)In(1 + 2,/n). Find limy++. Ln. 


Show that 5°°°,(—1)""' sin(Inn)/n? converges if and only if p > 0. Hint: Let 
f(x) =sin(In x)/x?. Observe that 77°, (—1)"t! f(n) = (fF (2n—-1)— f (2n)). 


Then use the mean value theorem. 


Let f be continuous on [0,1] and differentiable on (0,1). If |f’(x)| < 1 for all 
x € (0,1) and f(0) = f(1), prove that there exist 21,22 € (0,1) such that 


f(a) — Fle2)| < 5. 


Let f : [0,1] > [0,1] be non-constant continuous function. Prove that there exist 
21,02 € (0,1),21 # x2, such that 


|f (21) — f(w2)| = lar — 22)”. 


Let f be twice differentiable on [0, 1]. If | f’(x)| < 1 for all x € [0,1] and f(0) = 
f(1), prove that 


; 1 
I @lS5 


Let f be twice differentiable on (—1,1) and f(0) = f’(0) = 0. If 


for all x € [0,1]. 


[f"(a)| < |F()| + [f"(a)| for all x € (-1,1), 
prove that there is 6 > 0 such that f(a) = 0 on (—d, 6). 
Assume that f has bounded derivatives on (a, +00). Prove that 


lim f(a) 


z>too elnax 


= 0. 


Let f be continuous on [a, b] and twice differentiable on (a, b). If L(x) is the linear 
function which passes through (a, f(a)) and (6, f(b)), show that 


where M = maxzeja,v| |f” ()|- 


Let f be twice differentiable on [z,2 +h] and a € [0,1]. Show that there exists a 
6 € (0,1) such that 


Hauwah\ = ayant at ay shat se GHOn: 


(Optimal Property of the Taylor polynomial). Let T,,(a) be the Taylor 
polynomial of f(a) at x = a. Show that there is 6 > 0 such that 


|f(@) — Tn(a)| < [f(x) — p(@)| 


for every polynomial p(x) with deg(p(x)) < n on (a—6,a+ 0). 
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42. Show that 


43. For 0 <a < 5, show that 2sinz + tang > 3z. 


44. Prove the following inequalities: 


(a) IfO0<a<y< 7/2, then xtany > ytanz. 
(b) If x,y > 0, then m(a,y,t) = (2! + y*)!/* is decreasing with respect to t. 
(c) If p > 2,2 € [0,1], then 


(Oe, (12 lagen 


45. LetO< a; <7, (@=1,2,...n) and x = (a + %2+---+2p)/n. Prove that 


n 


sin x; sina \” 
Cs. 
XG x 


i=l 


46. Let a;,p; > 0 fori =1,2,...,n. Show that 


Pi t+ p2t+-+++Pn pi lina, + polnag+-+-+ pn nay 
Pl p2 4 Pn < exp 
a.) a,! Gn Pi + p2t+-+++Pn 


2 a + p2a2 ++++ + Pnan 
Pit p2t+-+++Ppn , 


47. Let a > 0. Show that 


48. (Putnam 1999-B4). Let f be a real function with a continuous third derivatives 

such that 
f(x), f(x), fe), f(a) > 0, — for all «. 

Suppose that f’’(a) < f(a) for all x. Show that f’(a) < 2f(a) for all a. 
Remark. Based on the total scores of the top 205 Putnam competition writers, 
this problem is viewed as one of the hardest problems in many years. Under the 
conditions of the problem, let C be the constant such that f’(x) < Cf(x). The 
third solution in [59] improved C from 2 to 2!/® = 1.12246.... The best possible 
constant C’ in the inequality seems still open. 


49. (Monthly Problem 10261, 1992). Let 0 < a < 1/4. Prove that 


(sin x)"™* < (cosa)°**. 


50. (Monthly Problem 10604, 1997). Determine positive numbers c and C' such 
that if 0<a< 6} then 


a 
Cc (1 — ) < sup 
b x>0 


Can you find the best possible constants such the above inequalities hold whenever 
O0<a<b? 


sin(az) — sin(ba) 


<c (1-¢). 


ax bx 
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51. (Monthly Problem 11957, 2017). Let k and n be two integers with n > k > 2. 
Let S(n,k) be the Stirling number of the second kind, i.e., the number of ways 
to partition a set of n objects into k nonempty subsets. Show that 


n®S(n,k) > k” al 


52. (Dobinski’s Formula). For n € N, define the nth Bell number by 


where S'(n,&) is the Stirling number of the second kind. Show that 


Co 


yo =e 


k=0 


os 


53. Let f be differentiable on (a,+ 00). If lim, (f(x) + f’(x)) = L, show that 
limyoo f(x) = L. 

54. Let f be continuously differentiable on R. If limy_,.. [(f’(x))? + f3(x)] = 0, show 
that limz. f(x) = 0. 


55. Let p(a) be continuously differentiable on R. Let f(a) be a solution of 


y" + p(ax)y’ —y = 0. 
If f has more than one zero, show that f(r) = 0 on R. 


56. Let f satisfy that f”(x) + f3(x) = 0 on (0,6) with f(0) = f(b) = 0. Prove that 
there exists a unique function f such that f(x) > 0 on (0,6) and 


[ens 


57. Let f be continuously differentiable with f(0) = 1. If f’(a) + e7f(x) +1 < 0, 
show that f(x) has a zero on [0,3/4]. 


58. Let f be twice differentiable on [a,b]. If f?(x) + (f”)?(a) = k? > 0, show that, 
for any x € [a, }], 


59. For every n € N, show that 
xn — 29h} 4 3g?M 2 4... — Ine + (2Qn+1) =0 


has no real solution. 


60. Let f be continuous on (a, +00). Let x, be distinct roots of f(x) with f’(a,) 4 0. 
Prove that limy_..5 tn = +o. 
61. Let f be twice differentiable on [a,b]. If f(a) = f(b) = 0 and f(c) > 0 for some 
€ (a,b), prove that there exists xo € (a,b) such that f” (ao) < 0. 


62. Let f be continuous on [a,b] and satisfy f(a) = f(b) = 0, f’(a) f(b) > 0. Prove 
that there exists c € (a,b) such that f(c) = 
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63. 


64. 


65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 


Let f be differentiable on [a,b] and satisfy f(a) = f(b) = 0, f’(a)f’(b) > 0. Prove 
that f’(a) =0 has at least two roots. 


Let f be a real-valued function with continuous nonnegative derivative and let D 
be the arc length of f on [0,1]. If f(0) = 0, f(1) = 1, show that 


a OO Tye Oe 


Let f be continuous on |a, b] and differentiable on (a,b). If f(a) = 0 and f(x) > 0 
on (a,b), for every a > 0, prove that there exists 11,22 € (a,b) such that 


f(a) _  £'(ea) 


f(x1) f (x2) 


Let f be continuous on [a,b] and differentiable on (a,b). If f’(a) = f’(b), prove 
that there exists c € (a,b) such that 


f= f@) 


C—a 


f= 


(Monthly Problem 10739, 1999). Suppose that f : [0,1] — R has a con- 
tinuous second derivative with f(x) > 0 on (0,1), and suppose that f(0) = 0. 
Choose a € (0,1) such that f’(a) < f(1). Show that there is a unique 6 € (0,1) 
such that f’(a) = f(b)/b. 

Let f be twice differentiable on (a,b). If f”(a) = f’(b), prove that there exists 
c € (a,b) such that 


Let P(x) be a polynomial of odd degree and a € R such that P”(a) 4 0. Prove 
that for any t € (0,1/2) there exists b 4 a such that 


P(b)—P 
PO)-F@) _ prs + (1—2)e). 
b-a 
Let f be continuous on [0, 1] and differentiable on (0,1) with f(0) =0, f(1) =1. 
For any given positive numbers c1,¢2,...,¢n with )>;_, ce = 1, prove that there 
exist distinct numbers x1, 22,...,2n € [0,1] such that 
S71; 
», f(r) 


Let f be continuous on [0, 1] and differentiable on (0,1) with f(0) =0, f(1) =1. 
Show that for each n € N there exist distinct numbers 21, 72,...,%n € [0,1] such 
that 


ae 


f'(te) = 1. 


> 
Il 


1 
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73. Let f(z) = cosx + cos? x +--++ cos” z. 
(a) For any given n €N, prove that f,(a) = 1 has a unique solution on [0, 7/3]. 
(b) Let x, € [0,7/3] be the unique solution of f,(a) = 1. Prove that 


. 7 
lim z¢, = -. 
n—o0o 3 


74. Let f(v) =1—-a2+ a +-+++(-1)"©. Prove that f(x) = 0 has exactly one real 
root when n is odd while f(x) = 0 has no real root at all when n is even. 


75. Let p,(x)=1+24 


= Fes ae Prove that 

(a) pn(x) > 0 for all x € R when n is even. 

(b) pn(x) = 0 has a unique solution in R when n is odd. 
(c) pon(x) > e” > pon4i(x) when x < 0 

(d) e* > pp(x) > (14+ a/n)” when x > 0. 


76. Let f(x) be twice continuously differentiable on [0,a] and satisfy the functional 


equation 
(5) +1(-2) =} re 
Find f(z). 


77. Find a function which satisfies the functional equation 
2f2(«) — f(x) = 1. 


78. (Putnam Problem 2005-B3). Find all differential function f : (0,00) 7 
(0,00) for which there is a positive number a such that 


for all x > 0. 


79. (Putnam Problem 2010-B5). Is there a strictly increasing function f : RR 
such that f’(#) = f(f(x)) for all x? 


80. (Putnam Problem 2009-B5). Let f : (0,00) > R be differentiable such that 


for all a > 1. Prove that lim, f(x) = co. 


81. Let f(x) = op_, che®*”, where a; (k = 1,2,...,n) are distinct real numbers 
and ¢1,C2,.--,Cn are not likewise zero. How many real roots can f(z) have? 


82. Let f be differentiable on [a,b] with f(a) = 0, and let g be bounded on [a, }]. If 
for any nonzero constant A, 


f(x)g(@) + Af"(a)| < [f(@)|, for a € [a,b], 
show that f(x) = 0 on [a, }]. 
83. Let | f’(x)| < M on [0,a]. If f attains the maximum in (0,a), prove that 


|f’(0)| + |f’(a)| < Ma. 
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84. 


85. 


86. 


87. 


88. 


89. 


90. 


91. 


92. 


93. 


94. 


Let f : [0,1] — R be continuous and differentiable on (0,1). If f(0) = 0, f(x) 40 
for all a € (0,1), prove that, for any n € N, there exists an xv € (0,1) such that 


nf'(vo) _ f’A= xo) 


f(@o) = f(l— 20)" 
Let f : RR be twice differentiable. If | f(a)| <1 and 


f?(0) + (f'(0))? =4, 
prove that there exists c € (—2,2) such that f(c) + f’(c) =0. 
Let f be (n+ 1)th differentiable on [a,b]. Assume that f()(a) = f(b) = 0 for 
k =0,1,...,n. Prove that there exists ¢ € (a,b) such that f(t) (c) = f(c). 
Let f be differentiable on [a,b] and ab > 0. Prove that there exists an x9 € (a,b) 
such that 


1 
b-—a 


Ho) 0) |= 1000) ~ 20) 


(Monthly Problem, 11892, 2016). Let f be a real-valued continuously dif- 
ferentiable function on [a, b] with positive derivative on (a,b). Prove that, for all 
pairs (1,22) with a < a <a < band f(x1)f(x2) > 0, there exists € € (a1, x2) 


such that 
if (®2) — taf (x1) 
f(w2) — f(a1) 
Let f be convex on [0, 00) with f(0) = 0, f(a) > 0. Prove that f(a) /x is monotone 
increasing on (0, +00). 


Let f be convex on (a,b), and L(x) be a linear function with L(x) < f(x). Find 
L(a) such that 


=€ 


b 
| G@-L@)ae 
is minimal. 
Let fi, f2 be nonnegative convex on [0,00) and fi(0) = f2(0). Prove that 
fi(x) fo(x)/x is convex on (0, +00). 


Let f be continuous on [a,b] and twice differentiable in (a,b). For any x; € 
(a, b],p; > O(i = 1,2,...,n) with >", p; = 1, show that there exists c € (a,b) 
such that 


‘3 (>: ns] — 0 pif (ei) = ein do pips (es — 2)’. 
i=l i=1 i<j 


Clearly, Jensen’s inequality is the consequence of this result. Moreover, it gives 
the error estimates of Jensen’s inequality as well. 


Let f be differentiable on (a,b) with f’(2) 4 0. Show that there exist c,d € (a,b) 
such that 
Gh ge ers of 


fd) b-a” 
Let f : [a,6] + R be continuous and differentiable on (a,b). Prove that there 
exists c € (a,b) such that 

2 2 


a eS a 
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95. 


96. 


97. 


98. 


99. 


100. 


101. 


102. 


103. 


104. 


Differentiation 


Let f be twice differentiable on [a,b]. If f’(a) = f’(b) = 0, show that there exists 
c € (a,b) such that 
4 
Ss b _ : 
f= Gaye lt) - Fa) 
Let f be twice differentiable on [a,b] and f’((a + b)/2) = 0. 
(a) Show that there exists c € (a,b) such that 


LO1> Gage VO - FC. 


(b) Show the constant 4 in the above inequality is the best possible one. 
(c) Show that, if f is not constant, then there exists c € (a,b) such that 


Goa lfO)- £00) 


Let f be continuous on [0, 1] and differentiable on (0,1). If f(1) — f(0) = 1, prove 
that, for every k = 0,1,...,2—1, there exists x, € (0,1) such that 


IP") > 


n! 
P(x) = kl(n —1—f)! we(L ~ a4) 


n—1-k 


Let f be twice differentiable on R and f(x) > 0. If there exist xo such that 
f(xo) < 0, limz 4-1 f’(x) = a < 0 and lim, f’(z) = 8 > 0. Prove that 
f(x) = 0 has exactly two solutions. 

Let f be continuous on [a,b] and f(a) = f(b) = 0. If f is twice differentiable and 
f(x) < 0, show that f(x) > 0 on {a, db]. 


Let fo(x) = 1, fn4i(x) = efn(x) — ff) (a) Prove that 

(a) fn(a) is an nth degree polynomial with the leading coefficient 1. 

(b) fn(x) has n distinct real roots, which are distributed symmetrically about 
xc=0. 


Let f : R ~ (0,co) be an increasing differentiable function for which 
limy—oo f(x) = co and f’(x) is bounded. Let F(x) = fy f(t)dt. Define the se- 
quence a, by 


do = 1, Gn41 = Gn + ( for n > 0 


1 
F(an)’ 
and the sequence b, = F~+(n). Prove that limn..o(an — by) = 0. 

Let f : R—R be continuously differentiable function that satisfies that f’(a) > 
f(f(«)) for all 2 € R. Prove that f(f(f(x))) <0 for all x > 0. 


Let fa) = sin@*) | Show that the Taylor series of f(a) diverges every- 


n=0 
where except x = 0. 


The nth Legendre polynomial is defined by 


1 dd” 


= —_ —_(g7 — 1)” apy Ie rea 
pant dane )y", (n=1,2,...,) 


P,(2) 


For example, P(x) = 2, Po(x) = $(3x? — 1), P3(x) = $(5a° — 3x). Prove that 
P,(«) has n distinct roots in (—1, 1). 
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105. 


106. 


107. 


108. 


109. 


110. 


111. 


(Monthly Problem 6585, 1988). Prove that if —1 < x < 1, then 


3 sin(k arccos x) _ ve “ 1—P,(t) dt 
k = 4 Je—t 


k=1 


where P,,(a) is the nth Legendre polynomial. 


Remark. Since |P,(t)| < 1 for all t € (—1,1), this provides a proof of the Fejer- 
Jackson inequality 


n . ké 
yo a So, 0<0<n. 
k=1 


(Monthly Problem 11641, 2012). Let f be a convex function from R into R 
and suppose that f(a + y)+ f(a —y) —2f(x) < y? for all real x and y. 


(a) Show that f is differentiable. 
(b) Show that for all real x and y, 
If'(@) — f'Y) S |e —yl- 


Let f have derivatives of all orders on R and |f)(x)| < M for all « € R,k = 
0,1,.... Let E C R be a infinite but bounded set. If f(#) = 0 on E, show that 
f(x) =0 for all x ER. 


Let A = (a;;) be an n x n matrix and 


dO = So apd. 


j=l 


Given (11, %2,..-,2%) with x; > 0, define yj = a ajj;v;. Prove that 


Show that, for any x € R. 


a |a—1| 
- = arctan a| <- 
4 J/ax2+1 
For 0 < x < 7, show that 
x sine x 
1 1.1 
3 x 4 


Jordan’s inequality claims that sinz > 2 x for x € [0,7/2]. Prove the following 
improved Jordan’s inequality: If « € [0, 7/2], then 


2 4+ 222(n — 22) <sng< 22+ 4a(n — 22), 
2¢4+4a(n*-40*) <snag< 22+ %22(n? — 427), 
24 + sts a(n* —16z4) <sinz < 24 + a4 — x(n* — 16a*), 


where the coefficients are all the best possible. 
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112. Let f be a function that has a continuous third derivative on [0, 1]. Assume that 
f(0) = f’(0) = f”(0) = f’(1) = f”(1) = 0 and f(1) = 1. Prove that there exists 
c € [0,1] such that f’’(c) > 24. 


113. Let a; be positive for all 1 <i <n. Prove that 


114. Let a;,b; be positive for all 1 <i<n with 77, a; = Cy_, b;. Show that 
S- ay Ina; = De a; In B;. 
j=l j=1 


115. Let f: I — (0,00) such that e°* f(a) is convex in J for all real number c. Prove 
that In f(a) is convex in I. 


116. Let f+) (a9) 40 and 


n—1) x n 
Fla +h) = Flta) + $"(ao)h-+ ++ + LAE 4% fN(a + 008), 
where 0(h) € (0,1). Prove that 
. 1 
on nt+1 


117. Let f be n times continuously differentiable on (xo — 6,20 + 6). Let 
F" (wo) = Ff" (eo) =» = FO (ao) = 0, 
but f( (29) £0. For 0 <h <6, if 
f(@o +h) — f (xo) = hf" (xo + O(h)h), 
where 9(h) € (0,1). Prove that 


1 
lim O(h) = = 
118. Let F ss 
(1 + =) =e = 
x rare 
Show that 


6-0" Erte (Gea) 


119. Consider the differential equation x(t) + a(t)x>(t) = 0 on [0,00), where a(t) 
is continuously differentiable and a(t) > k > 0. If a’(t) has only finitely many 
changes of sign, prove that any solution x(t) is bounded. 


120. (Extension of Pélya’s Problem (See Example 1.23)). Let x, be a positive 
sequence satisfying z,4, = f(a,) and x, + 0 as n + oo. Assume that 


f(z) =2+ Aa* + o(z*") (x > 0), 


where k € N,k > 1 and A ¥ 0. Show that there is a constant a > 0 such that 
limp+o nx® exists and determine the limit. 


) 


Integration 


I will not define time, space, place, and motion, as being well known to all. 
— Isaac Newton 


The art of doing mathematics consists in finding that special case which contains all the 
germs of generality. 
— David Hilbert 


In this chapter we study the Riemann integral on a finite closed interval. We assume 
familiarity with this concept from a first-year calculus sequence, but try to develop the 
theory in a more precise way than typical calculus textbooks. We establish the criteria of 
integrability and the sense in which differentiation is the inverse of integration. 


5.1 The Riemann Integral 


Our first question is therefore: what meaning should we give to f f(x)dax ? 
— Bernhard Riemann 


In most calculus textbooks, the common approach to introduce the concept of integration 
was defined as the inverse process of differentiation, often called “antiderivatives.” Here it 
is implicitly assumed that such an antiderivative exists and is unique up to an additive 
constant. Recall Darboux’s theorem (Theorem 4.6), we see that any function with a jump 
discontinuity cannot be a derivative. In other words, if we define integration in terms of 
antiderivative, it results in a very limited number of functions that can be integrated. For 
example, a function as simple as the floor function is not integrable. Thus, we need a 
careful development of integration theory. In particular, we expect that is independent of 
differentiation. Finally, around 1850, Cauchy, following the work of Riemann, motivated 
by computing areas between the function and the horizontal axis, rigorously defined the 
integration as the limit of a Riemann sum. 

Throughout this chapter, we assume that [a, b] is a finite interval. First, to conform with 
the most modern approach, we introduce some notation and terminology. 


Definition 5.1. Leta <b andneEN. If there are a finite set of points x0, 21,...,%n with 
A=% <4 <-+++ << Bpn_1 < Ln =|), 


then P = {ao0,...,%n} is called a partition of [a,b]. A partition P* of [a,b] is called a 
refinement of P if it contains all the points of P, t.e., P C P*. 


Definition 5.2. Let f : [a,b] > R be an arbitrary function. Given a partition P = 
{zo,-.--,2n} of [a,b] and a set of tags c; € [x;_1, 2;] fori =1,2,...,n, let Av; = x; —2j_1. 
The Riemann sum R(f, P) is then given by 


AUP y= » fle) Aaj. 
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Definition 5.3. Let f : [a,b] > R be an arbitrary function. f is Riemann integrable on 
la, b] if there exists a real number I satisfying the following property: for every « > 0, there 
is a 6 > 0 such that for every partition P = {xo,...,¢n} with ||P|| = maxi<i<n Ar; < 6 
and for any set of tags c; € [xi-1, xi], we have 


n 


S° f(ci)Aai —1 


i=l 


|IR(f,P)-I|= <e. 


The number I is called the definite integral of f on [a,b] and is denoted by ie f(x)dz. 


The significance of this definition is that the integral is a limit and its existence has 
nothing to do with antiderivatives. Moreover, this definition also ensures that the definite 
integral of f is unique. Suppose that both J; and Iz are the definite integrals of f. By this 
definition, for every € > 0, there is a 6 > 0 such that for every partition P = {xo,..., Xn} 
with ||P|| = maxi<;<, Ax; < 6 and for any set of tags ¢; € [w;-1, a], we have 


n 


S- f (ci) Ax; = Ti, 


i=l 


|R(f,P) — el = <5 


for k = 1,2. Then 


n 


esas 
w=1 t=1 
< Ip ores S- f(c)Ax; + ye f (cq) Ax; = I 
w=1 t=1 
<i+i= 
cae aN 


Since ¢€ is arbitrary, we must have I; = Ig. 
Furthermore, this definition implies that if f is integrable, then f is bounded. 


Theorem 5.1 (The Necessary Condition for Integrability). If f is integrable on 
[a, b], then f is bounded on |a, b]. 


Proof. Assume that f is integrable. Let « = 1. Then there exists 6 > 0, for any partition 
P = {xo,...,%n} with ||P|| < 6 and for any set of tags ¢; € [a;-1, 2] (1 <7 <n), such that 


n 


S> f(a)Ax; - 1 


i=l 


<1y (5.1) 


We show that f(a) is bounded on [a,b] by contradiction. Suppose that f(x) is unbounded 
on [a,b]. Then f(x) is unbounded on some [x#;-1,2;] with 1 < j < n. We now choose 
&} € [v;-1, xj] such that 


[f(E)Azj|>1+|S" f(c)Azi| + [I]. (5.2) 
iAj 
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On the other hand, by (5.1), we have 


[F(E Aas] =]{ D> f(c)Aas t+ f(E)Aa; | —I- > fle)Aai +1 
i iAj 


do fla)Aait f(&)Az; | -1]+|S> fle)Aai| + [71 
ifj tAj 


IA 


IA 


1+ /S> f(e)Aai| + [J]. 
tAj 


This contradicts (5.2). Thus, f is bounded on [a, 6]. 


However, a bounded function is not necessarily integrable. 


Example 5.1. Consider the Dirichlet’s function which is defined on [0,1] by 


1, if x is rational, 


Des { 0, af x ts irrational. 
Then D is not integrable on (0, 1]. 


Indeed, for any partition P = {x9,71,...,%n} of [0,1], by choosing c; € [#;~-1, x] rational 
and irrational, respectively, we obtain 


R(f, P) =1 and R(f, P) =0 


correspondingly. The integrability of D(x) will violate the uniqueness of the definite integral. 

One difficulty with Definition 5.3 is handling the variability of the set of tags c; since 
ci, © [aj-1,x;] is arbitrary. Similar to study the convergence of bounded sequence via the 
supremum and infimum, Darboux used the supremum and infimum of the set {f(x) : 4 € 
[x;-1, 2;]} around the set of tags. 


Definition 5.4 (Darboux Sums). Let f be bounded on [a,b] and P = {xo,..., Un} be a 
partition of [a,b]. For 1 <i<n, let 


m, = inf{ f(x): a € [ej_1, 7;]}, M; = sup{f(x) : x € [a;_1, a] }. 
The upper and lower Darbour sums associated to the P are defined by 


U(f, a5 M;Ax; and L(f,P -y mAx;, 


i=l 
respectively. 


Clearly, for a given partition, every Riemann sum is always squeezed by its upper and 
lower Darboux sums. Moreover, for any p € (a;_1,2;) for 1 <i <n, we have 


yA Sint fe) e ees vl ep) a (ae) 2 eee [ey es =) 


MAzx; > sup{ f(a) : x € (2:1, p]}(p — vi-1) + sup{ f(x) : x € [p, vi] }(ai — Pp). 
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Consequently, we obtain 
Theorem 5.2. Let f : [a,b] > R be bounded. 
1. For every partition P of [a,b], ifm < f(a) < M, then 
m(b—a) < L(f,P) < R(f,P) <U(f,P) < M(b— a). 
2. If P* is a refinement of P (i.e., P C P*), then 
Li PyY SAP) Ss ULF) SOG, P). 
Next, we show that the inequality L(f,P) < U(f,P) also holds for different partitions. 
Theorem 5.3. Let P, and P: be any two partitions of [a,b]. Then 
L(f, Pi) < U(f, Pe). 
Proof. Using the refinement partition P* = P, U P, as a bridge, by Theorem 5.2, we have 
L(f, Px) < L(f, Px) < U(f, Pe) <U(f, Pa) 


Thus, a reasonable definition of ic f(x)dx must be some number between L(f, P) and 
U(f,P) for any partition P. As the partition gets refined, we see that the upper Darboux 
sums get smaller while the lower Darboux sums get larger. Therefore, it makes sense to 
define 


Definition 5.5. 
L(f) = ip f dx =sup{L(f,P): P is a partition of |a,b])} (lower Darbousx integral) 
<b 
U(f) =f, fdx =inf{U(f,P): P is a partition of [a,b])} (upper Darboux integral) 


Darboux used the definition that f is integrable on [a,b] provided L(f) = U(f). More- 
over, he established the following result on one partition sufficing criterion for integrability. 


Theorem 5.4 (Darboux Theorem). Let f : [a,b] > R be bounded. f is Douboux in- 
tegrable on [a,b] if and only if for every « > 0 there exists a partition P of [a,b] such 
that 


U(f,P) — L(f, P) = 5° (Mi — mi) Ax; <e. (5.3) 


i=l 


Proof. “= >” Suppose that f is Douboux integrable. For every € > 0, there are partitions 
P, and Py, of [a,b] such that 


L(f,Pi)>L(f)— 5 and U(f.Pi) <U(f) +5. 


Let P = P, U Py. By Theorem 5.2, we have 
<U(f) +5 - (LU) - §) 
=U(f)-Lf)te=e (use U(f) = L(A) 
This proves (5.3) as desired. 
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“<—=” Suppose that for every « > 0 there is some partition P such that (5.3) holds. 
Then 


U(f) < U(f, P) =U(f, P) — Lf, P) + Lf, P) 
RePL(fue) See L( fy: 


Since ¢ is arbitrary, we obtain that U(f) < L(f). This, together with the fact that L(f) < 
U(f) from Theorem 5.3, yields that U(f) = L(f). Thus f is Darboux integrable. 


Remark. The characterization of Darboux integrability (5.3) for some partition can be 
replaced by: For every « > 0 and any partition P of [a,b], there is a 6 > 0 such that 


U(f,P)-—L(f,P) <e¢ whenever ||P|| < 6. (5.4) 


We leave the proof to the reader. 

In contrast to Definition 5.3 on the Riemann integral, where in order to show the inte- 
grability by that definition, one must first have a candidate for the number I (the value of 
the definite integral) in mind, the Darboux theorem characterizes the integrability in terms 
of the upper and lower sums getting closer to each other. There is no need to know what 
number the upper and lower sums approaches. 

We now show that both Riemann’s and Darboux’s definitions of integrability indeed are 
equivalent. 


Theorem 5.5. Let f : [a,b] > R be bounded. f is Riemann integrable on [a,b] if and only 


if it is Darboux integrable, in which case the values of the integrals are same. 


Proof. Suppose that f is Darboux integrable on [a,b]. For every Riemann sum R(f, P) 
with ||P|| < 6, we have 
LP, f) < R(P, f) < U(P, f). 
By (5.4), we also have 
U(f,P)< Lf, P)+e< Lf) +e 


and 
Since U(f) = L(f), combining these three inequalities yields 


|IR(f,P)-U(f)il <e« 


for every partition P of [a,b] with ||P|| < 6. This proves that f is Riemann integrable and 
its value of the integral is U(f). 

Next suppose that f is Riemann integrable in the sense of Definition 5.3. For any par- 
tition P = {a = 20, 21,...,2%n = b} with ||P|| < 6, we choose c; € [;-1, xi], 1 <i <n such 
that 

f(a) <m; +e =inf{f(x): 2 € [x;_1, 2;]} +e. 


The Riemann sum R(f, P) associated with this choice of c;’s satisfies 


and 
RiP) 2] =e 


where J is the value of the Riemann integral. Then 
L(f) = L(f, P) = RUPP) — e(b—a) > T-€- (ba). 


Since € is arbitrary, we obtain that L(f) > I. Along the same lines, we can show that U(f) < 
I. Hence we have L(f) = U(f) = I, ie., f is Darboux integrable by the definition. 
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5.2 Classes of Integrable Functions 


By one of those insights of which only the greatest minds are capable, the famous ge- 
ometer (Riemann) generalizes the concept of the definite integral. — Gaston Darboux 


Combining of Darboux theorem and Theorem 5.5 gives us a simple test on Riemann 
integrability: For each « > 0, we just need to find one partition P for which U(f,P) — 
L(f,P) < «. Based on this fact, we study which classes of functions are integrable. The 
following well-known result was asserted by Cauchy in 1823. But it was proved rigorously 
only some 50 years later with the notion of uniform continuity. 


Theorem 5.6. If f is continuous on [a,b], then f is integrable. 


Proof. The uniform continuity of f implies that for every « > 0 there exists a 6 > 0 such 
that Z 
f(z) — f(y)| < = whenever |x — y| < 6. (5.5) 


Let P = {%o,...,%n} be a partition of [a,b] with ||P|| < 6. By the extreme value theorem, 
there are uj, v; € [x;-1, v;] such that 


mi = f(ui), Mi = fui). 
It follows from (5.5) that 


for alll <i<n. Hence 


UG, P 2 Ty Li 1) — Do mi(wi — 21-1) 


This shows that f is integrable by the Darboux theorem. 


The following theorem shows that monotone functions are also integrable. 
Theorem 5.7. Every monotone function f : [a,b] > R is integrable. 


Proof. Without loss of generality, we assume that f(x) is increasing. Since f(a) < f(x) < 
f(b) for all x € [a, 6], f is bounded on [a, b]. Let P = {xo,...,2%,} be the uniform partition 
of [a, b] such that 


Ag; = 24 - %j-1= = °= 4096) f(@) <« 


Then 


U(F, Pa) — LF, Pa) = D | (flee) — Fea) 


The integrability of f now follows from the Darboux theorem. 
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What about a discontinuous function? If f is discontinuous, for every partition, then 
there are subintervals that contains the discontinuity points where M; — m,; cannot be 
arbitrarily small. To have integrability, if we choose a small bound for U(f,P) — L(f,P), 
then we need an even smaller bound on the total lengths of these subintervals which contain 
the discontinuity points. The following theorem demonstrates how to control the lengths of 
the subintervals so that they contain a finite number of discontinuity points. 


Theorem 5.8. If f is bounded and continuous at all but a finite number of points in |a, b], 
then f is integrable. 


Proof. Let M = supyzeja, f(z),m = infrefae] f(w). Assume that f is discontinuous at 
&, (i =1,2,...,N). For every « > 0, takeO< p< TMaomFyN such that (%;—p,%;+p) (¢= 
1,2,...,N) are disjoint. By assumption, f is continuous on [a,b] \ UM, (i — p, ti + p) = 
M1 ([a, 2] \ (Zi — p, Fi + p)). Since 


[a, b] \ (Zi — p, Ti + p) = [a, Ti — pl U [% + p, O], 


by the uniform continuity of f on these sets, there exists a partition P’ with M; — mj; < 
ay Now, P’, adding (%;—p,;+:) (¢ = 1,2,..., N) forms a partition of [a, b], we denoted 


it by P. Then 


a € 2Ne 
(b—a)+(M m) > 2p <5 +(M ap ee 


UF.P)-LUP)S 59> 


We conclude that f is integrable by the Darboux theorem. 


Definition 5.6. If there is a partition P = {xo,...,%n} of [a,b] such that f is a constant 
on each (aj-1, 2i], (i =1,2,...,n), then f is called a step function. 


In this case, f has at most a finite number of discontinuity points. Therefore, 
Theorem 5.9. A step function is integrable. 


The next example shows that an integrable function may have infinitely many disconti- 
nuity points. Recall that Riemann’s function is discontinuous at every rational point. But, 
we have 


Example 5.2. Riemann’s function R : [0,1] > R defined by 


_ Jf 0, if ts irrational in (0, 1], 
coe { -, if2£= 2,(m,n) =1. 


is integrable and sb R(«)dz = 0. 


Proof. To see this, for every € > 0, choose ng € N such that no > 2/e. Let 


A={re (al Rte) > =}. 


no 


Then « € A if and only if « = m/n with (m,n) =1and1<m<n< no. Since 1 € A, Ais 
a finite nonempty set. Let M be the number of members in A. Clearly, M > 1. 
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€ 


Let 6 = 557. For any partition P = {%9,%1,...,2n} of [0,1] with ||P|| < 6, we have 
L(R, P) =O and 


n 


U(R, P) = Mile: - t-1) =S- sup R(x) (a; — xj-1) 


j=] ©E([@i-1,2%] 


= > sup R(a)(e—aia)+ dO sup R(x)(#i — %-1) 


{i=1,...,.n;~E A} re [vi-1,24] {i=1,....n;~ZA} v€[xi-1,0%] 
1 
a S- 1+ (aj — 241) + | Se, Tee 
{i=1,...,.n;~E A} {i=1,....n;~ZA} 


n 


1 1 € € 
SNe Oe aI Se Se 
Page Li-1) ae eS € 


We conclude that R(x) is integrable by the Darboux theorem. 


This example demonstrates that the obstacle to the integrability of a function is not 
only its discontinuity, but also how the values of the function vary in some subintervals. 
For a function to be integral, it seems that the set where the function is discontinuous (for 
example, the set A above) cannot be “too big.” Motivated by this example, let 


wy = wil fy [eit ©) = Me = may (5.6) 


which is called the oscillation of f on [x;-1,2;]. This leads to the following Riemann’s test 
for integrability. 


Theorem 5.10 (Riemann Theorem). Let f : [a,b] ~ R be bounded. f is integrable on 
[a,b] if and only if for every €,p > 0 there exists a partition of [a,b] such that 


S- Au; <e. (5.7) 


wi=p 


Proof. “= >” Assume f is integrable, by the Darboux theorem, for every €, > 0, there 
exists a partition P = {xo,...,2»} of [a,b] such that 


U(f,P) —L(f, P) = — wiAaj <e-p. 


i=1 


Thus, 


n 


p: S- Ani < 5 wiAa <e-p, 
wirp i=l 
and so (5.7) holds. 
“<——” By assumption, for every € > 0, there exists a partition P of [a,b] such that 


€ 
;< ——__.. 
d, Ans (M—mt+) 


Wi? 3a) 
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For this partition, we have 


n 


U(f,P) — LF, P) = >> wiAai 


i=1. 
= SS) wdgt SY wAxi 
Wi < 305 =ay Wi2 aay 
€ 
Si sz Ax; + (M —m) pe Ax; 
Wi< 36 =ay Wi2 Iba) 
“__ (b—a)+(M—m) : 2 
Otay "9M —m+l ~ © 


This implies that f is integrable by the Darboux theorem. 


Drawing on Theorem 5.10, Lebesgue began working on infinite sets of discontinuities and 
finally revealed the actual continuity character of Riemann integrable functions. In short, 
he proved that Riemann integrable functions must be continuous almost everywhere. 

The journey begins with focusing the oscillation (5.6) onto a single point. The oscillation 
of f at xo is defined by 


w(f, xo) = int w(f, [zo — 6,20 + 4] M [a, B)). 
Thus, a function f is continuous at xo if and only if w(f,20) = 0. For every 6 > 0 we define 
= {x € [a8] : w(f,a) > d}. 
Clearly, f has a discontinuity at each point in Ds. Let 
D(f) = {a € [a,b] : f is discontinuous at x}. 


It follows that 
D(f) = {x € [a,b] : w(f, x) > Of = Usso0 Do. 


Since 0 < 6, < 62 implies that Ds, C Ds,, it follows that 


=| | Dif (5.8) 
n=1 


The following definition made the meaning of, a set is not “too big,” precise. 
Definition 5.7. A set of real numbers A has measure zero if for every € > 0 there exists a 
collection of bounded intervals {(ai, b;); 1 < i < co} such that 

A CUR, (ai,b;) and a b; — ai) 
Definition 5.8. A property holds almost everywhere, if it holds for all x in the domain 
except for a set of measure zero. 


The laws of set operations allow us to establish many examples of sets of measure zero. 
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Example 5.3. The following sets all have measure zero: 


1. A set with finite number of elements. 

2. A set with countable infinitely many elements. 
3. A subset of a set of measure zero. 

4. Countable union of sets of measure zero. 


Equipped with Definitions 5.7 and 5.8, Lebesgue succeeded in yielding a simple charac- 
terization of Riemann integrable functions. 
Theorem 5.11 (Lebesgue Theorem). Let f : [a,b] + R be bounded. f is Riemann 
integrable on {a, b] if and only if f is continuous almost everywhere. 


Proof. “= >” Suppose that f is integrable on [a,b]. Fix 6 > 0, for every € > 0, there exists 
a partition P = {%9,21,...,%} of [a, 6] such that 


3 wj;Ar; <e- 


a 


=1 
If x € Ds N [ai-1, vi], then w; > w(f,x) > 6, and so 


Ax; < = 
DsN[ai-1,2iJ4O 
Clearly, 
€ € 
Ds Cc U (xj-1, Us) U («, , 04 ) . 
Dente seaded = 4(n + 1) 4(n + 1) 
Since 


2€ €  € 
DsN[xi-1,2:] AO 
by Definition 5.7, this implies that Ds is a set of measure zero. In view of (5.8), D(f) is a 
countable union of sets of measure zero. Hence D(f) also has measure zero. 
“<—” Let |f(x)| <M. The fact that D(f) has measure zero means that for every € > 0, 
there are open intervals {(a,;,8;) : 7 € N} such that D(f) C U;(a;, 6;) and 


€ 
285 — 95) § GT 
When zx € [a, }] \ U;(a;, 8;), since f is continuous at z, it follows that there exists a open 
interval I,, where x € I, and w(f,In) < b=)’ Thus, {(a,;, 8;), Jz} constitutes an open 
cover of [a,b]. By the Heine-Borel theorem, there is a finite subcovering of [a, b]. Select a 
partition P of [a,b] such that either [x;_1,2;] C (a;,8;) for some j or [%;_1,x;] C I, for 
some «x. Hence, 


2 wiA = = w;A; + S- w;A; 
i=1 [wi-1,%:]C(aj,B;) [wi-1,¢i]CIa 
< 2M S- a Sa 


2(b— a) 


[wi-1,04]C(aj,8;) [w;-1,0:]CIe 


< 2M S° (8; - 04) + 
j 


€ E€ 
ae) ee 
= aio 


This implies that f is integrable by the Riemann theorem. 


2(b — a) 
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The Lebesgue theorem demonstrates how discontinuous function can be but still be 
Riemann integrable. It provides an intuitive idea of integrability in terms of the discontinuity 
set. Based on this theorem, a function that is discontinuous only at the rational numbers is 
not very discontinuous. It finally enables us to leave the Riemann integration as a historical 
subcase. 


5.3. The Mean Value Theorem 


All intelligent thoughts have already been thought; what is necessary is only to try to 
think them again. — Johann Goethe 


Let f be continuous on |a, b]. Geometrically, the inequalities 
b 
min {F()}(b—a) < f Fle)de < max {F(2)}(6~a), 
x€[a,b] x€ [a,b] 


can be viewed as the area of a region under a curve is greater than the area of an inscribed 
rectangle and less the area of a circumscribed rectangle. The following theorem states that 
somewhere “between” the inscribed and circumscribed rectangles there is a rectangle whose 
area is precisely equal to the area of the region under the curve. 


Theorem 5.12 (The First Mean Value Theorem for Integrals). If f : [a,b] > R is 
continuous, then there exists xo € [a,b] such that 


b 
/ fla)de = f(2o)(b— a). 


Proof. Since minzejasj){f(x)} < f(x) < maxzefayj{f(x)} for all x € [a,b], we have 


min {f(2)} < -— fs flejde < max {f(2)}, 


x€ [a,b] 


The present theorem follows from the intermediate value theorem. 


In view of the above proof, if g : [a,b] > R is a nonnegative integrable function, then 


min {f(x of 9 ade < f° seal x)dx < ed [ote 


x€ [a,b] 


Thus, there exists xo € [a,b] such that 


dh iorGr mic if eis 


If, in addition, assume that g(a) is monotone, by using Abel’s summation formula (Theorem 
2.24), Bonnet and Weierstrass established 


Theorem 5.13 (The Second Mean Value Theorem for Integrals). Let f : [a,b] > R 
be continuous. 
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1. Ifg : [a,b] — R is decreasing and g(x) > 0 on [a,b], then there exists € € |a, b] 


such that 
b € 
y f(a)g(a)de = g(a) / fle)de. (5.9) 


2. Ifg : [a,b] > R ts increasing and g(x) > 0 on [a,b], then there exists n € [a, b] 
such that 


b b 
/ f(a)g(e)de = 9(0) / f(a)de. (5.10) 


3. If g : [a,b] > R ts monotone, then there exists € € [a,b] such that 


[ seoateyee = xo) [ f(a)de + 9(b ff fa (5.11) 


Proof. (1) By the assumption that g is monotone, Theorem 5.7 implies that g is integrable 


on [a,b]. Thus, for every € > 0, there exists a partition P = {2o,...,2n} of [a,b] such that 
iS wi(g)Ax; <e. 
i=1 

Let F(x) = J” f(t)dt. Then F is continuous. Furthermore, 


rn Flalalayte = ae 
: vf Fe ete + > ae) i OCe 


< yf g(ai-a) If (@ Nate + Yo a Hii) — F(x;-1)| 
< uy wilg yan SF g(xi-1) — g(xi)| + F(b)g(@n-1) 
< Me+ - F(z): 3 [a(vi-1) — g(zi)] + a F(z) - g(&n-1) 


i=l 
= Me+gQ(a)- max F(z). 
x€ [a,b] 


Here Abel’s summation formula is used in the second inequality above. Replacing f by —f, 
notice that maxz¢{a,o)(—F(x)) = — minzejas) F(x), the argument above shows that 


[ —f(x)g(a)dx < Me -—g(a)- min F(z). 
x€[a,b] 
In summary, we find that 
g(a): pan ee) —Me< A f(a)g(x)dx < g(a): max F(x) + Me. 
rela 


Since € is arbitrary, we must have 
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If g(a) = 0, together with g is decreasing and nonnegative, g must be zero. Thus, 
£ f(x)g(x)dx = 0. If g(a) 4 0, then 
b 
d 
min F(a2) < Ja f(x)o(u)de < max F(z) 
x€ [a,b] g(a) x€ [a,b] 


(5.9) now follows from applying the intermediate value theorem to F'(z). 

(2) The proof of (5.10) is similar except replacing F(x) by he f(a)da. 

(3) First, we assume that g is decreasing. Let G(x) = g(x) — g(b). Then G is monotone 
and G(x) > 0. By (1), there exists € € [a,b] such that 


| f(x)G(a)de = G(a) i ; f(e)de. 


Plugging G(a) = g(x) — g(b) yields (5.11) as desired. When g is increasing, (5.11) follows 
by applying (2) to G(x) = g(x) — g(a). 


We close this section with an application of the second mean value theorem for integrals. 


Example 5.4. Let 8 >0,b>a>0. Then 


b : 
_3,Sinz 
eRe dx 
i" x 


Indeed, let f(x) = sin, g(x) = ae Here g(x) is decreasing and positive on [a,b]. By 
(5.9), there is € € [a,b] such that 


b : —Ba & —Ba 

sin x € e€ 

i, e PtP de = / sinadx = (cos a — cos €). 
a v a a a 


s 


a) 


Therefore, 


5.4 The Fundamental Theorems of Calculus 


“This link was confirmed by Newton and Leibniz. For this achievement, we honor them 
as the discovers of calculus.” — David Perkins 


There are two versions of the fundamental theorems of calculus. Roughly speaking, each 
says that differentiation and integration are inverse operations. The first version 


b 
[ fide = FO) - Fa) 


is the central result of all the integral computations. It enables us to evaluate an integral that 
does not require the explicit evaluation of upper and lower Darboux sums. The combination 
of the two versions yields 


F(x) = F(a) + i F'(t)dt. 


Thus, with the help of a limit process (definite integral is a limit), one can recover the 
function itself based on its given derivative. The above approach provides the crucial step 
on the road to studying general differential equations. 
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Definition 5.9. Let f: [> R. F(a): I — R is an antiderivative of f if F’(x) = f(x) for 
alla eI. 


Theorem 5.14 (The First Fundamental Theorem of Calculus). Suppose that f is 
integrable on [a,b], and F(a) is any antiderivative of f on (a,b). Then 


b 
/ f(a)dx = F(b) — F(a). 


Proof. Let P = {xo,...,%n} be a partition of [a,b]. By the mean value theorem, there 
exists € © (a;-1,7;) such that 


F(a;) — F(a_1) = F’(&) (a — vi-1) = f(&) Avi, i= 1,2,...,n. 


Thus, 


n n 


F(b) — F(a) = )> (F(a) — F(wi-1)) = 95 f (Ei) Aci. 


i=l i=l 


The assumption of integrability of f yields 


n b 
FQ)-Fla)= jim Yo fG)Aa= [ Fleae. 


The following example shows the necessity of the integrability of f in this theorem. 
Example 5.5. Define 
x? sin (+) , «#0, 
Ee { 0, xr=0. 
Here F(x) is differentiable on [0,1] and 


bias. 2x sin (+) _ 2 cos(4), x #0, 
F(a) ={ 0, xz =0. 


F'(x) is unbounded on [0,1] and therefore f(x) = F’(a) is not integrable. 


Smooth action. Let f : [a,b] + R be integrable. Then the function 


F(a) =f plea 


is continuous on [a, ]. If we strengthen the condition of integrability with the condition of 
continuity, we have another cornerstone of analysis. 
Theorem 5.15 (The Second Fundamental Theorem of Calculus). Let f : [a,b] > R 


be continuous. Then the function 


P= if f(t)at 


is differentiable on (a,b) and satisfies F'(x) = f(x). Hence, F is an antiderivative of f(x). 
Proof. Suppose f is continuous at xo € (a,b). Note that 


F(a) — F(a) 


«— XO 


= say | MOH #20) 
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and 


fey fo sleovde 


zt — Xo 


Thus, 


PO) ~ EO) — §¢09) = > J (40) = S00) (5.12) 


«— XO xr — XO 0 
For every € > 0, the continuity of f implies that there exists 6 > 0 such that 
If(t) — f(@o)| <€ 
whenever |t — xo| < 6,t € (a, 6). It follows from (5.12) that 


F(a) — F(20) 
«a — XO 


— f (x0) 


<e 


for x € (a,b) satisfying |v — x9| < 6. This shows that 


xL—->XO wv — XO 


= f (Xo). 


This theorem asserts that every continuous function has an antiderivative. By the 
Lebesgue theorem (Theorem 5.11), if f is Riemann integrable, then f is continuous almost 
everywhere. Therefore we have 


& [ seoae= se) (5.13) 


almost everywhere. On the other hand, the following example shows that a Riemann inte- 
grable function has no antiderivative. 


Example 5.6. Consider 
fl, ffl<a¢<2, 
fe) ={ 2, if2<«£<3. 


As a step function, f(x) is integrable on [1,3]. Recall that a derivative has no jump 
discontinuity, f(a) is not the derivative of any function defined on [1,3]. So f has no an- 
tiderivative! Thus, there is a class of integrable functions for which 


b 
i fede = Ft) 2%) (5.14) 


is not directly applicable. The question naturally arises: when F' is an antiderivative? The 
search for a concise characterization of all possible derivatives remains largely unsuccessful. 
Even if we extend the Riemann integral to the Lebesgue integral, (5.14) is true only when 
F is absolute continuous. For details, see Royden’s Real Analysis [81, Chapter 5]. 

Coupled with the chain rule, if f is continuous, u(x) and v(a) are differentiable, (5.14) 
can be extended to 


d u(x) 


a f(t)dt = f(u(x))u'(x) — f(v(x))v(2). (5.15) 


The next result, known as integration by parts, is very useful in dealing with integrals. 
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Theorem 5.16. Let u,v : [a,b] > R be differentiable. If u'(x) and v'(x) are integrable, 
then 


b b 
/ u(x)v' (a)dx = u(x)v(a) |? -{ u (x)u(x)da. (5.16) 


Another important technique of integration is known as “substitution—change of vari- 
able.” This process is the reverse of the chain rule. 


Theorem 5.17. Let f : [a,b] > R be continuous. If x = $(t) is continuously differentiable 
on [a, 8] such that 9([a, B]) C [a,b], d(a) = a, (8) = b, then 


b B 
| fa)dx = / F(o(t))6!(#)at. (5.17) 


5.5 Worked Examples 


The greatest challenge to any thinker is stating the problem in a way that will allow a 
solution. — Bertrand Russell 


In this section, we present 24 examples to illustrate the applications of the integral 
theorems. The first four examples demonstrate some nonstandard tricks for computing 
integrals. 


1. Evaluate [ rs. 


Solution. The standard approach is to use partial fractions. But it is much simpler 


to introduce : 
dx x 
[= —— d J= ——_d 
/ 14+ 24 / 14+ 24 in 


1+2? 1+ 1/2? 
I dx = | =— d 
Te I ge late " 


te) 1 _, {(«-1/2 
5d =— : 
=f (x — 1/2)? +2 ‘ Pr ( J2 ) oe 


1l-«z 1-1/2? 
I-J= d. 
# {[ ae- eae - 
= / Cea! dx = : pee 
(a+1/x)? — 2 2/2 g+1/e—V/2 


Solving the system yields that 


i dx 1 xg —1 1 met v2e+1 


Since 


= — arctan 


— In T 
l+a* 2/2 J2e 4/2 v2?-V2r+1 


Remark. Along these same lines, we can evaluate a class of integrals such as 


x . d m/4 
i ees dx, / as (a#b), and | In(sin x) da. 
er ane = asinz + bcosx 0 
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2. Let n be nonnegative integer. Evaluate ale 1608 rit dx. 


Solution. Denote the proposed integral by [,,. For n > 1, we have 


1 ™ 2—cos(n + 1)x — cos(n — 1)x 
3 Unsa + In-1) - | aoe ae 
™ 1—cosnx cos x 
- | 1—cosx 7 
= ™ (1—cosna) + cos na(1 — cos) aie 
0 1 —cosx 
= In. 


This implies that J, is an arithmetic sequence. Since Jj = 0 and I, = 7, we find 
that I, = nr. 


3. For n EN, evaluate 
& sinnr 
I, = ——__—— d 
ie (1+ 2°) sing” 


Solution. Splitting the integral into two parts, we have 


0 3 ae , 

sin nx sin nx 
i= dx 4 —d 
is (1+ 27) sina * i (1 + 2°) sina - 


Making the substitution u = —z in the first integral yields 


a sin nu t sin nx 
Lax ——__—_—— d ——__——-_d 
| (1+ 2-”) sinu ut | (1+ 27) sina * 


aif (14+2 JE 
9 (14+ 27)sina 


ae 
sin nx 
= - dx. 
9 sing 


For n > 2, it follows that 


wT Os ie 2 T 
| ae a ‘p sn ee eee er, i cos(n — 1)a dx = 0. 
0 0 


sin x 


Using the facts that Jp = 0, [,; = 7, we conclude that 


7 ={ m, nis odd, 


0, mis even. 


4. For |2| < 7/2, let 6(7) = — fy Incost dt. Prove that 


o(x) = -eln2 +26 (4 | > 29 (4 =). 
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Proof. Note that 
(-em2-+26( +$) -20(§-2))'=-maee'(E+8) +6 (§-3) 
=— |n2 Incos (7 + =) Incos (4 ) 


T 2 x of 
—In [2 cos ( + ) cos ( )I 
4 2 A. 52 
-, 


— In(cos 7/2 + cosx) = —Incosxz = ¢'(a). 


Thus, the claimed identity follows from $(0) = 


Let f,g : [a,b] ~ R be Riemann integrable, and let P = {29,71,...,%n} bea 
partition of [a,b]. Prove that, for every set of tags €;,7; € [ai_1, vi], 


sips, fey oe [ reas 


Proof. The integrability of f and g implies that f(a)g(a) is integrable on [a, bJ. 
Thus, for every € > 0, there exists a 6; > 0 and a partition P = {xo,21,...,2n} 
of [a, b] satisfying ||P|| < 6, such that 


where &; € [z;_1, xi]. Let M = sup, ¢jq.) |f(x)|- Since g is integrable, there exists 
d2 > 0 such that 


yy wi(g)An;, < CEST +1) 


whenever ||P|| < 62. Now, when ||P|| < 6 = min{d1,62},6,7; € [xi:-1,2i], we 
have 


DoS (E)a(m Aas — Yo MEdal (Gdn) < So iF(Gdlla(n) — 916) 1A0 


i=l 


< MY~|a( la(n) — g(&i)|Aai < MY lux(g )Axi 
i=1 i=1 


(ss € 
<MoMmeD. 2 


Therefore, by the triangle inequality, we have 


YFeomdc— [ f(x)g(x)dx| < 


g(m) Axi — ys &i)g (Ei) Axi 


«lS ree (€:)Aas — [ tes ax)dx 


ar te 


This proves the claimed result. 
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6. Let f : [a,b] > R be Riemann integrable. 


(a) Prove that there exists xo € (a,b) such that f is continuous at 29. 


(b) If f is nonnegative and Riemann integrable on [a, b], show the following state- 
ments are equivalent 


(1) fo f(a)dx = 0. 
(2) f(a) = 0 where x is a continuous point of f. 
(3) f = 0 almost everywhere. 


(c) Let f be nonnegative and bounded. If f = 0 almost everywhere, does 
Sf? f(w)dx = 0? 


Proof. (a) By the Lebesgue theorem, f is continuous almost everywhere. Since 
(a, b) is not measure zero, it follows that f is continuous at some po € (a,b). Here 
we give a different proof—using the nested interval theorem to find the point 
Xo. To this end, first, for every € > 0, we show that if P = {29,21,...,¢n}isa 
partition of [a,b] such that U(f,p) — L(f, P) < e(b — a), then there exists some 
subinterval [#;-1,2;] on which w;(f) < €. By contradiction, if w;(f) > ¢ for all 
i(1<i<n), then 


e(b—a) > U(f, P) —L(f, P) = Dewi( fA > So Aaj = €(b-a). 


i=1 
This contradiction shows that w;(f) < € for some 1 < i < n. In particular, let 
€ = 1 and [ay, by] C [a;-1, x] C [a,b] such that b) — ay < bee Then 

w(f, [a1, bi) < w(f, [wei 24]) <1. 


Next, let « = 1/2. Since f is integrable on [a,,6,], it follows that there exists 
[az, bg] G (a1, 61] such that be — ag < a and 


ih 


w(f, [aa, ba]) <— 2 


Repeat the process above to obtain a sequence of closed intervals that satisfy 


e [an, On] Cc [a@n—1, On—1] and b, — dn < one 
© w(f,[an,bn]) < +. 


By the nested interval theorem, there exists 7p € N° [@n, bn] such that 


0<w(f,%) = lim w(f,[an,b,]) < lim oe 0. 
noo noo N 
Thus, w(f,2o) = 0, which implies that f is continuous at xo. In fact, such xo is 
dense in [a, b]. For any t € [a,b], let (a, 8) be an arbitrary neighborhood of t. The 
integrability of f on (a, 3) NM [a,b] asserts that there is zo € (a, 8)N a, b] at which 
f is continuous. So the set of continuity points of f is dense in {a, 6]. 


(b) (1) > (2) By contradiction, assume that f (ao) 4 0 where xo is a continuous 
point of f. Without loss of generality, assume that f(xo) > 0 and xo € (a,b). The 
continuity of f at xo implies that there exists (a9 — 6,209 + 6) C (a,b) such that 


f(x) > 5 fo) for x € (ap — 6,2 + 6). 
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Thus, we have 
b xrot+d 1 xo+d 
o=| f(x)dx > if f(a)dx > al f(xo)dx = bf (x0) > 0. 
a xro—d xro—8 
The contradiction shows that f(x) = 0. 


(2) = (3) By the Lebesgue theorem, f is continuous almost everywhere. The 
assumption of f(a) = 0 at continuous points concludes that f(x) = 0 almost 


everywhere. 
(3) = (1) Observe that f = 0 almost everywhere implies that f(x) = 0 has 
solution in every (a, 3) C [a,b]. Let P = {xo,21,...,2%n} be a partition of [a, b]. 


Taking &; € [a;-1,7;] such that f(€;) = 0 yields 
b 
/ f(x)dz = 7 lim S° f(€:)Aai = 0. 
S i=1 


(c) Dirichlet’s function provides us an example that a nonnegative, bounded and 
zero almost everywhere does not necessarily have zero integral value. 


7. Let f : [a,b] > R be continuous. If 


b b 
i f(x)dx = 0, i uf (x)dx = 0, 
show that f(x) has at least two zeros in (a, b). 


Proof. We give two proofs. 


Proof I If f has no zero at all in (a,b), by its continuity and the intermediate value 
property, we find that either f(a) > 0 or f(x) < 0 for any x € (a,b). This yields 


that either { f(x)dx > 0 or f f(x)dx < 0, which contradicts the assumption. 


If f has only one zero 2g € (a,b), then f has opposite sign on (a,x) and (Zo, b). 
Thus, (a — x0) f(x) does not change sign on (a,b). Therefore, 


b 
: (a — xo) f(x)dx #0. (5.18) 


On the other hand, 


[e — x0) f(x)dx = [ af (x)dx — xo i f(x)dx =0. 


This contradicts (5.18). Hence f must have at least two zeros in (a, b). 


Proof IIT The assumptions of the continuity and that ah f(x)dx = 0 imply that f 
has at least one zero in (a,b). By contradiction, we assume that f has only one 
zero at 2. Appealing to 


o= f seye= [” ploydes | ployde, 


we have 


i. Ce i Lie 2, (5.19) 
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Similarly, we rewrite 


b xo b 
/ xf (x)dx = i xf (x)dx + i: uf (x)da. (5.20) 
a a xo 

Applying the first mean value theorem for integrals gives 


[ xf (x)dx = & i f(x)dx and a af (x)dx = € ie f(x)dz, 


i) 


where a < ; < % < &2 < b. In view of (5.19) and (5.20) , we have 


o= f “aie GB) f(x)de #0. 


The contradiction shows that f has at least two zeros in (a, b). 


Remark. Based on this result, by induction, we can show that if 
b 
i z* f(x)dx =0 fork =0,1,...,n 


then f has at least n +1 zeros in (a,b). 
8. (Riemann Lemma). Let f : [a,b] > R be Riemann integrable. Show that 


b b 
lim f(x) sin px dx = lim : f(x) cos px dx = 0. 
pro Ja 


poo a 


Proof. Due to the similarity, we prove that limp. ifr f(x) sin prdx = 0 only. By 
the assumption, for every € > 0, there exists a partition P = {x,%1,...,%n} of 


(a, 6] such that 
6 n 
/ f(v)dx —S° m Ax; 
e i=1 


where m; = infre[r,_,,0,) f for 1 < i <n. Let M = supz,ejay |f(z)|. Choose 
p> 4nM Using that f(x) — m; > 0 on [a;-1,2;] for 1 <i <n, we have 


n Xj 

) / m, sin px dx 
t=1 VY Fi-1 

n vi 

) ‘| m, sin px dx 
4a Fed 


Ss m,(cos(px;) — cos(px;_1)] 


€ 
= 21 
ig (5.21) 


b 
/ f(x) sin px dx| < + 


ey) (f(x) — m,) sin px dx 
qs eh 


2] (f(a) — m,)| sin px| da + 


This proves that limp... i f(x) sin px dx = 0, as desired. 
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Remark. If, in addition, assume that f is continuously differentiable, integrating 
by parts will yield a brief proof. On the other hand, For each partition P = 
{xo,@1,..-,@n} of [a,b], define a step function 


Sp(a) = 


{ M4, x € [%i_1,%i),¢=1=1,2,...,.n—1 (5.22) 


Mn, © € [€Xn—-1, Ln]. 
(5.21) becomes 
b 
J (f@)~Sia)yae < §. 


Thus, f is approximated by a step function. The following problem provides a 
stronger version—that f can be approximated by a continuous function. 


9. Let f : [a,b] > R be Riemann integrable. Prove that for every « > 0, there exists 
a continuous function ¢ : [a,b] > R such that 


[ucw- x)|\dx <e. 


Proof. Since f is integrable, for every « > 0, there exists a partition P = 
{xo,21,..-,2n} of [a,b] such that 


b 
/ (F(a) - Su(e))de < & 


where S,,(x) is given by (5.22). For each S,,(a), define 


Mi, x € [aj-1,0; — 0] 
o(x) = m+ HH (x — 24), x € (a; —6,a;], 7=1,2,...,n-—1 
Mn; LE (atn—1,2nl 


where 0 < 6 < min{ gaz, Mini<i<n Avi}, M = supzeja pj |f(x)|. Clearly, o(x) is 
continuous on [a, b]. Thus, 


fu lf x)|dz < "If(e) — Sala) |de + “ise Oe Nee 
‘ n—-1 a“; . 
n-1 
< 5+ 2Md < 5 + 2nM < ste=e 


Remark. By the Weierstrass approximation theorem in Chapter 6, which asserts 
that every continuous function on [a,b] is a uniform limit of polynomials, the 
above result can be further strengthened to: For every «€ > 0, there exists a 
polynomial P(x) such that i | f(x) — P(a)|dx <e. 


10. Let f : [0,7] > R be Riemann integrable and n € N. Show that 


lim ie f(z)| sin na| dx = 2 [ f(a) dx 
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11. 


Proof. Let P = {x0,#1,...,%n} be the equal partition of [a,b]. Then, for 1 <i < 


in Be ig 
mf | sin na|dx < | f(x)| sin na|dx < My; | | sin na|dx, 
i-1 1 i-l, 


——-7 ——-F7 
n n 


where 
m, = inf{f(a): a” € [(@-1)a/n,in/n]}, M; = sup{ f(z): x € [G@—1)2/n, ia/n}}. 


Summing up these inequalities on 2 from 1 to n yields 


a 


y mf" | sin na|dx < / f(z)|sinna|da < ) M, [” |sinna|dx. (5.23) 
i-1 wal 
i=1 Fema D ae 


MT 
a 
n™ 2 
|sinna|dx = —, 
in, n 
m 


n 


Since 

it follows from (5.23) that 

gee T ® : Dw 1 

= So mi— < f(x)|sinna|dx < — S > M;-. (5.24) 
Serer a 0 mn 


a 


The integrability of f implies that 


” 1 ” 1 : 
li i-= li M;— = da. 
dim, Soom = Jim SoMa = [floyd 


The desired statement now follows from (5.24) and the squeeze theorem. 


Remark. We assume that f is continuous on [0,7], the statement can be proved 
by using the first mean value theorem for integrals. 


Let f : [-1,1] > R be continuous. Show that 


Proof. Since f is continuous, it follows that, for every « > 0, there exists a 7 > 0 
such that bs 

Ife) - FO < 
Let M = maxz¢/~1,1)|f()|. For such fixed 7, there exists a 6 > 0, if |h| < 6, we 
have 


whenever |x| < 77. 


—7n h ‘4 —7n h d 
es < M ye 
HT, Aa 4 gat ehde = T, h2 + x? oe 


1 
h 
/ Paw f(a)dx 
n 


2 aretan 7 —-7T) < —. 


IA 
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nk =e ; ; 
Li mera tee— ns] <[f pagge Fite] +f pee fe 


rf ee fee - aF00) 


<$44|/6) ye a te nF(0) 


aes: + [2 (E>) arctan 7 a wf (0)| 


2 
< 5 2|f (En) — f(O)| arctan 7 + |2 arctan 2 — n| | f(0)| 
oe A ee 
2°4°4 
This proves the statement. 
Remark. Here gp(x) := 4 preg is called the Lorentzian kernel. It is singly peaked 


at x = 0 but with a total area of unity. Let 
O(a) := jim gn (2). 


It is often called Dirac’s delta function and it has the fundamental property: 
| £@)l2) ax = £0) 


for every function f(x). The Delta function can also be defined as the following 
limits: 1 sin|( 1/2)2] i 
sin|(m + x 2 fo_2 
=i = lim =e" 7, 
(2) 5S De sin(x/2) a+ anor 


The function in the first limit is called the Fejér kernel, which is used to express 
the effect of Cesaro summation on Fourier series. The function in the second limit 
is named the Gaussian kernel that is widely used in probability and statistics, 
differential equations, and other areas of mathematics. 


12. Let f : [0,1] > R be continuous. If lim,_,9+ fe) exists and is finite, show that 


jinn [se an = f 1. 


f@) x € (0, 1], 


limy_5o+ ft) x=0. 


Clearly, g(a) is continuous on [0,1]. Let G(a) = 1 g(t)dt. Using integration by 
parts, we have 


ait f(a™)dx =n x"g(x")dex = «G(a”)|) — G(x")de 
0 0 0 
=G(1)- i G(x")dx = [ MO = a G(a")de. 
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Now, it suffices to show that limy +5 ie G(a")dz = 0. To this end, let M = 
maxz¢0,1] |G(x)|. Observe that, for any 0 <a <1, 


: <[ (ajar = f IG(a")jae+ IG(e")|dx. (5.25) 


Applying the first mean value theorem of integrals yields 


if G(a")dx| = lee a dec 


where 0 < €, < a. Thus, for every € > 0, choosing a > 1 — 


SalG(Gn)|, 


= 
aa we have 


lim_G(gt) =G (lim, en) = G(0) =0. 


This implies that there is a positive integer N such that |G(€?)| < § for all 
n > N. Thus, in view of (5.25), we have 


(a™)dax 


€ € € 
ar te oe +) = 
Sgt a)M<>t5 € 


and the conclusion follows. 


13. Let f : [0,1] > R be integrable. Show that if f is positive on [0,1], then 


: (| seee) <a+f Pe 


Proof. Notice that 


f? 


sf = 3 (@r- 1% +1/4)- 3). 


Integrating the above identity on [0,1] yields 


[ Pe are ee? [Pea 


The desired inequality now follows from the Cauchy-Schwarz inequality 


- Ptoyae- f de > (/ f(e) dr) 


Remark. With the concave assumption, we can show that 


ye f(x) de <2 ([ fla)de) 


The following problem presents another lower bound for Hs f(x) da. 


14. (Monthly Problem 11819, 2015). Let f be a continuous, nonnegative function 
on [0,1]. Show that 


7 f(x) dx > 4 G4 1f(e) dr) (/ f(a) de). 


2 
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Proof. Since Te xdx = 1/4, the proposed inequality is equivalent to 


i: 2 af Pe) de> if ax? f(a) aw [ x f?(a) dz. (5.26) 


To prove this inequality, for 0 < t < 1, let 


F(t) -[ eae [ Pear f Py ade f a f?(x) dx 


Then (5.26) becomes that F'(1) > 0. To this end, applying the product rule, we 
find that 


“ty = [ p(a)ae . ese * ef? (a) de — tf? Piss 
o=6 | Pea +ro f d te Pad ro f f(a) d 
=) 2 p?(«)(tf(x) — f(t) yao [$24 f(t)x2 (f(t) — tf (a) de 
0 
= ‘i (2 f(a) — 22 f2(O) (tf (w) — ef (0) de 
= i (f(x) + ef ())(tF (a) — af (t))? dx 


This implies that F’(t) > 0 for all 0 < ¢t < 1. Hence F(t) is increasing on (0, 1]. 
In particular, we obtain that F(1) > F(0) =0. 


15. (Monthly Problem 11780, 2014). Let f : [-1, He — R be continuously differ- 
entiable up to the order of 2n + 2. If f(0) = f”(0) =--- = f2"*?)(0) = 0, prove 


that 
(4n + 5)(( Auge, (fia fla ye) A velinn 


Proof. Applying Taylor’s theorem with the integral remainder, we have 


f(x) = Tangi(@) + Ron+i(2), 


where 
2n+1 6(k) (2n-+2) (4 
f! (0) k i faa een 9) 2n4+1 
Ton41(£) — » il av and Ron4i(a (Qn+ + a —t) dt. 
Since f(0) = f”(0) =--- = f@"+?)(0) = 0, it implies that To,41(x) is an odd 


function and so 


1 
/ Ton41(x)dx = 0. 


-1 
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Therefore, 
1 
flo)dz =f Ronya(o)ar 
= . fOCA t) eae p ocbiata 3) 2n+1 
=f fs ‘Gn diy (t — 2) atars ff Gna (a — t)?"t dt dx 
_ 7 aia acai (2 t) aie pe @) 2n+1 
-[ [4 ‘Qnty! (t— x) dx a+ ff ‘Ont D! nt) dx dt 
a i FO") ¢ t) (t = | * | Egpheere ep t) E = ) 1 r 
_; (2n+4+1) 2n +2 Pee 9 (2n+1)! Qn +2 oe 
7 0 FOP ae 1 prey) Bag 
/ (Gn +2)! (t+ 1) dt 4 » Gn Fa)! 1—-t) dt 
1 ¢(2n+2) 
Vi Fo dt, 
where aad | 
14+4)°""*, #t€[-1,0), 
o(f) = { (1—1)2"42, £€ [0,1] 
Since 


1 
2 
2 t) dt = a 1 pant g | 1—t)4"t4q = 
[ Q+yettdrs f U-aittde= A, 


by the Cauchy-Schwarz inequality, we find that 


(/| seas) sf wot flares y 


=e ES: sf (F2"*(@)) dx, 


which is equivalent to the desired inequality. 


16. Let f be continuous on [0, Va? + 62]. Show that 


2n Tw 

Flacos8 + bsind) do =2 [ f(\/a? + 6? cost) dt. 
0 0 
Proof. Let 
é a ne b 
COs => =, sm = >... 
Yer ee 
Then 


acos@ + bsin@ = Va? + b?(cos@ cos ¢ + sin@ sin ¢) = V a? + b? cos(@ — @). 
Since cos(@ — ¢) is a periodic function with the period 27, it follows that 
otn 


Flacos6 + bsind)do = | f (Va? + 6? cos(@ — ))d0 


TT 


=| f(\/a2 +B? cost)dt (use t= 0 — 4) 


a) 


= 2 f(a? + 6? cost)dt. 


27 


0 
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17. (Gauss Formula). Let a > b > 0,a1 = ath and b; = Vab. Prove that 


m/2 dd m/2 dé 
G(a,b =| =| ; 
oe) 0 fa? cos? ¢ + b? sin? ¢ 0 pene, ai 2 
az cos? 6 + bj sin® é 


Proof. Let 
2asin 0 


(a+b) +(a—b)sin? 0 


sing = (5.27) 


Here ¢ varies from 0 to 7/2 as @ changes from 0 to 7/2. Differentiating (5.27) 
gives 

(a + b) — (a—b) sin? 0 
[(a + b) + (a — b) sin? 6]? 


cos ¢dd = 2a cos 6 dé. 


On the other hand, 


(a + 6)? — (a— b)? sin? 0 
= 4/1—sin?¢= v 0. 
cos @ sin” @ Gata) and cos 


Thus, 


(a +b) — (a —b) sin? @ dé 
do =2 : 
? " (a+b) + (a —b) sin? 6 (a +b)? — (a6)? sin? 6 


Since 


(a +b) — (a— b) sin? 6 


2 24+ 62 sin? d = , 
ye? cos? 9 + Hsin? 6 “(a-+) + (a —) sin? 0 


it follows that 


a - id (5.28) 


Va? cos? ¢ + b? sin? ¢ 0 cos? 6 + b? sin? 0 


Integrating both sides of (5.28) from 0 to 7/2 arrives at the Gauss formula. 


Remark. The substitution (5.27) that Gauss used is remarkable. Gauss must have 
known something which lead him rationally along the path. But he didn’t reveal 
any guidance of a proof which involves a great deal of algebra. Here we give an 
alternative proof with a simpler substitution. The idea is motivated by Putnam 
Problem 1968-B4: Let f : R — R be continuous. Show that 


[t(-3) av= f sle)ae. 


First, using the substitution u = btan ¢, we represent G as 


1° du 
aa 2 i J(u? + a?) (u? + 6) 
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Let u = $(x — ab/x). We have 


1 
du = 5,3 + ab)dx, 
1 ab\? 1 
i 1 p)2 
ua =F (« . ) q(4 ) 
1 
i 5 (2* 2abz? + a?b? + a?x? + 2aba? + b?x2) 
x 
1 
= Tale a*)(x? b?), 
1 b\? 
eei=z(« *) + ab 
1 
= ae (a* — 2abs? + a?b? + 4abzr) 
1 
(a? + ab)?. 


Ae AA 


Consequently, similar to (5.28), we find another invariance: 


du 2x Qe «x? +ab d 
— Xx 
J(u? + at)(u? + b7) J(u? + a?)(u? + b?) z+ab 2x? 
2dx 


VETER 
Integrating both sides yields that G(a1, 61) = G(a,b) again. 


The Gauss formula is significant. Its end result is very beautiful and striking. Let 


ae bn— 
an = Set et Ay An—1bn-1.- 


Repeatedly using the Gauss formula yields 


Gla.) = | Zt 
a,b) = ; 
0 ya cos? + b2 sin? d 


Recall that 


lim a, = Jim, by, := agm(a, db), 
n—->oco 


which is called the Gauss arithmetic-geometric mean. The Gauss formula finally 
yields 


Gta= fe 


18. Let 0<a,6 <1. Evaluate 


do _ 7 
~ 2Qagm(a, db)” 


(agm(a, b))? cos? ¢ + (agm(a, b))? sin? d 


dx 
-1 V1 — 2aa + 07\/1 — 28x + 6? 
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Solution. Let 
az’ + br +c = (1 — 2az + a”)(1 — 262 + A”). (5.29) 
Clearly, a = 4a > 0. Differentiating (5.29) yields 


ax + ; = —a(1 — 26x + 8”) — B(1— 2ax +07). 


Recall that 


d 1 b 
i 7 Injax + 5 + VaVac? + be +e} +0. (5.30) 
a 


Jaw e: Vv 


When x = 1, we have 


ant 3 + vavaa® tbx+e 


a(1 — 6)? — BL —a)? + 2V/oB(1 — a)(1 — B) 
= —[Vo(1— 8) — /8(. - o))? 
=-(Va— /8)?(1+ Vas)’. 
Similarly, when « = —1, we have 
art 3 + Vavaa® tbe te = ~(va- VB)(1 - Vo). 
Using (5.30), we conclude that 


if da otha, doh a8 
-1 V1 —2az + 024/1 2Br+B2 VaB 1-Vap 


I 


19. Find a nth degree polynomial P,,(x) such that 


b 
/ P,(x2)Q(x) dx = 0 
for any polynomial Q(x) with the degree up to n — 1. 


Solution. Observe that every nth degree polynomial P,,(x) can be obtained as the 
nth derivative of a (2n)th degree polynomial R(x), and R(x) can be determined 
by integrating P,,(a) n times. For each integration, in particular, we select the 
arbitrary integral constants such that 


R(a) = R’(a) =--- = R™ (a) =0. (5.31) 


We now transform the problem as follows: Find a (2n)th degree polynomial R(x), 
subject to (5.31), such that 


b 
R(x) Q(x) dx = 0. 
Thus, using integration by parts, we have 


b 
i R(x) Q(x) de = [Q() RO («) — Ql(a) R(x) 4 


b 
£Q@?Y(a)R(a)] [2 = | Q™(@)R(a) de. 


a 
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20. 


21. 


By (5.31) and Q(x) = 0, this leads to 
Q(b)R@-Y (b) — Q!(b)R@-?) (b) + --- Q@—Y(b) R(b) = 0. (5.32) 


Since Q is arbitrary, this implies that {Q(b), Q’(b),--- ,Q@~)(b)} are arbitrary 
too. Thus, (5.32) implies 


R(b) = R’(b) =--- = R™Y(b) = 0. (5.33) 


By (5.31) and (5.33), we conclude that R(«) has a and 6 as nth repeat roots. 
Therefore, we can choose R(x) = c(a — a)"(x — b)” with c 0 and so 


d” 


P,(a) =e F(a 


is one of the required nth degree polynomials. 


Remark. Let a = —1,b = 1. We obtain the well-known Legendre polynomials (see 
Exercise 101 in Chapter 4): 


1 d” 


~ Onn! dan 


P,,() [(u? — 1)"], 


which are frequently encountered in physics and other technical fields. Here the 
coefficient is normalized such that P,,(1) = 1. Moreover, {P,(x)}°2, are orthog- 
onal with respect to the L?—inner product: 


1 
2 
Py(@)Pm(x) dx = ———obnm; 
i (x) Pn (a) dx ay 


where Onm is the Kronecker delta, which equals to 1 if m = n and to 0 otherwise. 
An alternative derivation of the Legendre polynomials is by carrying out the 
Gram-Schmidt process on the polynomials {1,2,x?,...} with respect to the L?- 
inner product. 


Let f : [—1,1] > R be continuous. If i. f(sin(a + t))dx = 0 for all t € R, show 
that f(«) =0 for all x € [—1, 1]. 


Proof. Let u = x +t. Then the given integral becomes 


i 
| f(sinu) du = 0 (5.34) 


for all t € R. Differentiating (5.34) yields f(sin(t + 1)) = f(sin#) for allt €¢ R. In 
particular, for every n € N, we have 


f(sinn) = f(sin(n — 1)) =--- = f(), 


which indicates that f(sinn) is a constant for all n € N. Let f(sinn) = C. Recall 
that the set {sinn,n € N} is dense in [—1.1]. The continuity of f implies that 
f(x) =C for all x € [—1, 1]. Substituting f into (5.34) yields that C = 0. 


Let f be differentiable on [—1,1] and M = max_j<z< |f’(«)|. If there exists 
a € (0,1) such that [", f(x) dx = 0, prove that 


| / fd 


< M(1—a?). 
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22. 


Integration 


Proof. By applying the first mean value theorem of integral, there are € € [—a, 0] 
and & € [0,a] such that 


0 
fe) = of sea 
fea) = 2 ff sear 


a 


I 


respectively. On the other hand, the Lagrange mean value theorem implies that 


f@-fG) = £ln)\@—G), fora,m © (—1,-a), 
f@)-f@) = f'(m)(e@-&), for 2, € (a,1). 


Using the assumption that [“, f(x) dx =0, we have f (£1) + f(€2) = 0. Hence 


HI, f(x) dz] = i. ptayae+ [ f(a) dx 


2 We fla) de — f(€:)(-a + 1) — f&)(1—a) + / f(a) de 


=| fe) -senae+ fi@) = He) dr 


—a 


l| 


f(n)(e— &) de + / f' (na) — &) de 


cu(f nae fG £2) dr) 


= — M(2— 2a? + 2(@ — 1)(éo — €1)) 
(1 — a? + (a—1)(& — &)) 


(Putnam Problem Cee Suppose that f : [0,1] ~ R has a continuous 
derivative and that tok x) dx = 0. Prove that for every a € (0,1), 


x)dx| < > max |f"(x)|. 


1 
= 8 0<e<1 


Proof. Let M = maxo<e<i |f/(x)| and F(x) = f) f(t) dt. Since F(x) is continuous 


on [0,1], and 
F(0) =0,F(1 — 


by the extreme value theorem, there is x € (0,1) such that 


max |F (2) N= Leteayh =|" 40 ie 


O0<a<1 


Hence it suffices to prove that 
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By Fermat’s theorem, we also have F’(a19) = f(xo) = 0. To proceed, we represent 
F'(zo) in two different forms. Using integration by parts, we first have 


xo 


Fao) = tf005 — fer @ar=— [area 


On the other hand, using the assumption that ie f(x) dx = 0, then integrating 
by parts, we have 


Fi) = [soar f sae=—f seat 


Using these two forms, respectively, we find that 


|F(xo)| = i tf’ (t) a a) t| f’ (t)| dt <| Mtdt = Ma’, 

0 0 0 

1 1 1 1 
|F(xo)| = / (1—t)f’(t) a =, (1—‘t)|f'(®| dt < / M(1-t)dt= ae — 20)”. 

xo xo x0 
Therefore, 

1 i eens | 
|F'(ao)| < 5M min{ro, (1—2)?7}-< gM qag™. 


23. (Monthly Problem 11812, 2015). Let f be a twice continuously differen- 
tiable function from [0,1] to R. Let p be an integer greater than 1. Given that 


Dike f(k/p) = — 3(F (0) + f(1)), prove that 


a. f(x) ar) ast sr [ (f""(a))? de. 


Proof. For 1 < k < p, integrating by parts twice gives 


£05) Es) (2) 41(8))2 so 


Hence, 
k/p = 
Pay tap (GR) 7G) 
(k—-1)/p p Pp p 
1, fhe k—-1\(k 
ae oe Gra Ga 


Summing k from 1 to p yields 


fi 1-33 (FG) 4G) 


k=1 


7 = 3 i. (-- —) (= -1) f'(a)de. (5.35) 


"(ax) da. 
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By the assumption, we have 


= (4 (=) +f (=)) — 70) +25 Hlk/p) + (1) = 


k=1 


This simplifies (5.35) as 


[ f(a) de = = > i («- ae 1) (=-) f"(a)dx. (5.36) 


Applying the Cauchy-Schwarz inequality (the sequence form) yields 


5m (EP (FG) ree) 
oh (0. (SG) rem) 


Applying the Cauchy-Schwarz inequality (the integral from), we find that 


oS (L(A 4) (rr) 


k=1 
For 1 < k < p, direct calculation gives 


Weg k—-1\(k 1 
eagle Go) oe 
(k-1)/p Pp P 30 p 


Thus, 


P k/p ‘ 
sega bf utwran=ae fra 637 


Combining (5.36) and (5.37), we now arrive at 
1 or 1 1 : 
Suse OPS, te ” 
(| f(z) i) 1° sap | (fo (@))" da, 


Remark. The form of Se, (k/p) in the assumption also hints to us to use the 
Euler-Maclaurin formula: 


as desired. 


Sak) = f° ofc) de+ 5 (al0)-900))+ Gla) 5 f° Bal{e})g"(@) ae 
(5.38) 
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where Bj(x) = x?—x+1/6 is the second Bernoulli polynomial and {x} = r—|2] is 
the fraction part of x. This leads to a shorter proof. To this end, let g(x) = f(a/p). 
By the assumption, (5.38) becomes 


~(F'() - f°) 


1 1 1 es 
[ feyae= sy [ Balina}y"@)de- 


2p? 


= / (Bat{ne}) = 5) "(cha 
= | CPG Oe 


I 


Applying the Cauchy-Schwarz inequality and using 


' 2 2 = 1 
[ (nay? — {na} ae = 55 


we conclude the proposed inequality again. 


24. (Monthly Problem 12308, 2022). What is the minimum value of fo f'@))? dx 
over all continuously differentiable functions f : [0,1] > R such that fis f(a) dx = 
de ey (ada 1? 


Proof. The minimum value is 105/2. To this end, integrating by parts, then using 
the assumptions of f yields 


[ 20-2)F@de= 20-2) f@h- f se) - 30%) ae 
0 0 
--| fla)de +3 | xu f(a) dx = 2 


Applying the Cauchy-Schwarz inequality, we have 


fe (f 0-2) i) < ([ 20-2) ar) (f u'wyrar). 


2 


Since 
; 2 2\2 8 
1— dz = —~ 
i: x (1—a*)* dx 108’ 
we conclude 
105 


[ vores >. 


We now find a function f(x) that satisfies the assumptions and attains the value 


of 105/2. Let 
2 4 
fla)=0(F-F) +0, 


where a and £ are constants to be determined. Using 


: 7 
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we find a = 105/4, 6 = —33/16. Hence 


105 fx? at 33 210x? — 10524 — 33 
f(z) = = 
4 2 4 16 16 


This gives 


5.6 Exercises 


When I was young I observed that nine out of every ten things I did were failures, so I 
did ten times more work. — George Shaw 


1. Evaluate 
i dx 
1 (e* +1)(a2 +1) 


2. Evaluate 


27 
V1l+sinaz dz. 


0 


3. Let f : [-a,a] > R be continuous. Prove that 


[ flayae = f (Fe) + f(-2)) de. 
ate dx 
ere 


Use this formula to find 
4. Forn EN, find 
if = — dx. 
l+ot epee +e 


5. For n €N, show that 
n/2 
| cos(2nx) In(cos x) dx = 
0 


6. Show that P 
F(x) = -; arctan (3) 


vt —4e2 +1 


e441 


+61 - Lhen evaluate 


de el 
ey 
paar 
0 «6 +1 


7. Let f be a continuous function on [0, 1]. Show that 


is an antiderivative of 


m/2 m/2 
| f (sin? x) cosa dx = | f (cos? x) sin x dx. 
0 0 
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8. 


10. 


11. 


12. 


13. 


Let k EN and P(x) =14+a2+4+---+2*~1. Show that 


1 / 
i P, (2) a" de = Ink — (Hin — Hn), 
o P() 


where H,, is the nth harmonic number. 
Show that 


l~ 4/2 — 803 — 4/224 — 805 _ 
0 1- x8 


Remark. Computing the integral in terms of series yields 


% 1 4 2 1 1 
— é 
16"? \8n+1 8n+4 8n4+5 8n+6 


n=0 


In 1996, based on this remarkable series, Bailey, Borwein, and Plouffe found an 
algorithm for computing individual digits of 7. The series is now referred to as 
a BBP-type formula. Since then, a large number of BBP-type formulas for other 
mathematical constants have been discovered [10]. 


Consider the lemniscate defined by 


x(t) 
Let LD be its arclength. Show that 


2n = L- agm(1, V2), 


cos t sint cost 
=——z,, wt) = —z, OSES 20. 
1+sin’t 1+sin*t 


where agm/(a, b) is the Gauss arithmetic-geometric mean. 


teh ar 


i‘ sin” rdx. Show that 


(2n — 1)! (2n)! 


i= ag 
: Ga 2° Re nse 


Then use Ign41 < Lon < Ign 1 to prove the Wallis’s formula 


—_—_ 1 (2n)!! \? 
—~= lim : 
2 noo 2n+1 \(2n—-1)!! 


Let f be a decreasing continuous function on [a, b]. Show that 


b f(b) 
7 flo) de+ f fate mtiO e iO! 
a f(a) 


In particular, if f(a) = b, f(b) = a, then 


[ Fla) i= [ Pied 


Let f,g be integrable on [a,b]. Suppose that f is decreasing and 0 < g(a) < 1, 
prove that 


[sears [ seater s f 104, 


— a 


where a = i g(a) da. 
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14. Let f be continuous and strictly increasing on [a,b]. By the first mean value 
theorem for integral, for each n € N, there is x, € [a,b] such that 


b 
(Fan))" = f (F@)" az. 


Show that limy_,.5 fn = Db. 
15. (Monthly Problem 11961, 2017). Evaluate 


| ieee sin x 
0 1+ \/sin(2z) 


16. Let ’ be continuous on [0,1] and differentiable on (0,1). Suppose that 
Le x) dx = 3 f(0). Show that there exists ac € (0,1) such that f’(c) = 0. 


17. Let J, = (ee anon dt for all n € N. Determine 


lim ; 
n>oo Inn 
18. Determine the existence of the limit 
1 
dx 
lim 4 (ines i, a): 


19. Let f be a differentiable function satisfying f(1) = 1 and 


1 
ee 
TO" By Pe 
Prove that limz_,.. f(x) exists and is less that 1 + 7/4. 
20. Let 
1_ [2], £ (0,1), 
f(z) = { 0, a =0. 


Show that f is integrable on [0, 1]. 


21. (a) Find an example that f and g both are integrable on [0,1], but (f o g)(x) is 
not integrable. 
(b) If f is integrable and g is continuous on [0,1], prove that (fo g)(«) is inte- 
grable. 
22. Let f be integrable on [a,b] and ake f(x) dz > 0. Prove that there are subinterval 
[c,d] C [a,b] and uw > 0 such that f(a) > pw on [e, d]. 
23. Let f be convex on [a, b]. Show that 


(8) <- 


24. (Marcel Chirita). Let n > 2 be an integer. Determine all continuous functions 
f : [1,co) > R such that 


f(a) + FO) 4 f(b) 


x) dx < 


i parm fee tse ey soa 


for every x € [1, 00). 
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25. Let f : [0,1] > R be convex and decreasing. Define 
_1< 1 2h 
wr(E ) and sin) == > (2). 
Sore n n 


Show that S;.(n) is increasing and $}(n) is decreasing as n increasing. 


26. Let f : [0,1] > R be convex on [0, c] (0 < ¢ < 1), concave on [c, 1], and decreasing 
on (0, 1]. Define 


Show that $;.(n) is increasing and $;(n) is decreasing as n increasing. 
27. Let f : [0,1] > R be decreasing. Define 


1X k 
sin)== 9) (2). 
n n 
k=l 
If (f(a) + f(1 — x))/2 is concave, show that S,(n) is increasing as n increasing. 
28. Let both f(a) and f’’(x) be nonnegative on [0,1]. Define 


1S 2k —1 
Ata) 
k=1 
Show that a, is increasing as n increasing. 


29. Let f : [a,b] > R be a function such that 


lim f(a) 


LX 


exists for every Xp € [a,b]. Show that f is Riemann integrable on {a, }]. 


30. Let f be a nth degree polynomial such that a x* f(x) dx = 0 for k = 1,2,...,n. 


Show that , ; 
i f? (x) dx = (n +1)? (/ f(a) ax) 


31. Let a>0,A>0, and 0 <a < b. Prove that 
b 
A 
i) sin G =) dt 


= 1 
ij con(?) at <-. 
a a 


33. (van der Corput’s inequality). Let f be twice differentiable with f(x) > A> 
0 on [a, 6]. Show that 
b 
ee if (x) dz 


2 
els 
nm 


32. Let a > 0. Prove that 


So 
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34. 


35. 


36. 


37. 


38. 


39. 


AO. 


Al. 


42. 


Integration 


Let f be a continuous function on [0,1] such that i f(a) dx = 0. Show that 
there exists c € (0,1) such that 


= = fo f(x) dx 
. foe fo Sel fe dx 
(c) fo @ ie a = 0. 
(d) cf(c) om xf (a) dx if in addition assume that f is differentiable on 


(0, a 
(Monthly Problem 12046, 2018). Suppose that f : [0,1] > R has a continu- 
ous and nonnegative third derivative, and suppose is f(x) dx = 0. Prove 


1 1 1 
3 2 
10 | x fla)de +6 | xf (x) dx > 15 | x” f(x) da. 


Let f : [a,b] > R be twice continuously differentiable function with wh f(a)dx = 


oo 30((a) + FO)? 
f@yras ee 
a (b—a)* 
where 30 is the best possible constant. 
Hr Problem 11872, 2015). Let f be a continuous function on [0, 1] such 


that lef x) dx = 0. Prove that for all positive integers n there exists c € (0,1) 
such ao 


nf x” f(x) dx = c"*" f(c). 


(Monthly Problem 11933, 2016). For positive integer n, let H, = S°;_, 1/k. 
Prove 


1 1 1 n-2 
1 r+1 x bees +ae+1 1 
; Ne dz > . 
i me | Paget 7 ar-l4e.-t+a+1 ee 
(Monthly Problem 12205, 2020). Find the minimum value of 
Jo 0 (f(a)? dex 
J 2?(f(a))? de 


over all nonzero continuously differentiable function f : [0,1] > R with f(1) = 


(Putnam 2006- ee For oe oe function f : [0,1] > R, let ae 


fe x? f(x)dx and J(x = f, x( )?dx. Find the maximum value of I(f) — J(f) 
over all oe ee f. 


(Monthly Problem 12318, 2022). Let a be a positive real number, and let 
. ns the z of functions f : [—a,a] + R such that f“(f(ax))?da = 1. Let 


= J", f(a)de, Bf) = J", xf (x)dex, and O(f) = J", «? f(x)da 
(a) What is phe + B(f)? : fe Sg}? 
(b) What is sup{ A(f)? + B(f)? + C(f)? : f € Sa}? 


(1) [ In(1 + 2) de, (2) [ arctan & a 


1+ 2? lt+z 


Evaluate 
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43. 


4A. 


45. 


46. 


A7. 


48. 


AQ. 


50. 


Evaluate the Poisson integral 


| In(1 — 22 cos 6 + a”) dé. 
0 


Evaluate 
ie 2 14+sing , 
———_ e* du. 
n/4 1—cosx 
Evaluate es *Insin x dx. Then use this result to calculate 


l arcsin x 
dx 


i m/2 1 Inx 
zlnsinz dz, | xcot «dz, | ———_ dz, and i 
0 0 0 V1l-2? 0 x 


Let n EN. Evaluate 


mw/2 os _ m/2 7 2 
(1) i smn VES (pach <0) i) (==) dx (Fejer). 
0 0 


sin x sin x 


Show that 


1 
| ((n(VI-Fa ~ Via)? ~ a] dx = 5 m?2 5 n2 | “ + G, 
0 


where G is the Catalan constant defined by 
Ses 
ca Sa oer: 
(Monthly Problem 12221, 2020). Prove that 


1 6 
of ata dx == m6 3G, 
0 


1+ 2? 


where G is the Catalan constant. 


Remark. Similarly, you should be able to show that 


oo 6 
i LETS) aie 
0 1+ 2x2 


(Monthly Problem 11152, 2005). Evaluate 


’ In(cos(7a/2)) 
| oa 


(Putnam Problem 1980-A3). Evaluate 


i dx 
0 1+tanv? x 
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51. (Putnam Problem 2016-A3). Suppose that f is a function from R to R such 
that 


f(a) +f (1 - ~) = arctan £ 


[ eve 


52. (Monthly Problem 11924, 2016). Calculate 
m/2 t 
i {tan x} ce 
0 tan x 
where {u} denotes u— |w]. 


53. (Monthly Problem 11457, 2009). For real numbers a and b with O <a< b, 


find 
b 
/ arccos a dx. 
a (a + b)a — ab 


54. Let f : [a,b] > R be continuous and let g be a periodic function with period T. 


Show that : i: - 
tim, | f(t)g(nt) dt = z/ f(t) a. f g(t) dt. 


Remark. This is an extension of Problem 9 in Section 5.5. 
55. Let f be a periodic function with period T. If f is integrable on [0, T], show that 


im = fro PO =f soe. 


56. Let f be a integrable periodic function. Show that 


= * f(t)at 


can be represented as the sum of one periodic function and a linear function. 


57. Let f,(x) be continuous on (0, 1] with ie fn(x) dx = 1 for each n € N. For every 
positive constant M, show that there exists a positive integer N and constants 
ci, (@ = 1,2,...,N) such that 


) c=1, max 
«x€(0,1] 


i=1 


for all real x # 0. Find 


Hint: Use the mean value theorem of integral. 


58. Let f be continuously differentiable on [a,b]. If there are positive constants M 
and a such that 


x) dx| < M(d—c)'** for each [c,d] C [a, bj, 


show that f(x) = 0 on [a, 8]. 
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59. 


60. 


61. 


62. 


63. 


64. 


65. 


66. 


67. 


Let f : [0,1] > R be continuously differentiable. If f(0) = 0, f(1) = 1, show that 


[ we@- fi(a)|dx > =, 


Let f : [a,b] > R be continuous. If 


[10 cosine = 0, [ f(x)sinadx = 0, 
0 0 


show that f(x) has at least two distinct zeros in (0,7). 
Let f : [a,b] > R be Riemann integrable. If 


b 
i x" f(a)dx =0, forn=0,1,2,..., 


show that f(a) = 0 where x is a continuous point of f. In particular, if f is 
continuous, then f(x) = 0. 


Let f : [0,1] > R be continuous. If 


1 1 
| a® f(x) dx =0, fork =0,1,---,n—1, | x” f(a) da = 1, 
0 0 


show that there exists c € (0,1) such that |f(c)| > 2"(n + 1). 


Let f : [a,b] > R be continuous. If for every continuous function g(x) satisfying 


i g(x)dxz = 0, ; 
/ f(a)g(x)dx = 0, 


show that f(x) is a constant on [a, }J. 


Let f ie ca on [—1, 1]. If for any even function g : [—1,1] > R satisfying 
ies f(x)g(x) dx = 0, show that f is odd on [-1, 1]. 
Let f : . 1] > R be continuous. Show that 

1 


1 
lim x” f(x)dx =0 and tim n x” f(x)dx = f(1). 
0 


n—-Co 0 


Let f : [0,1] — R be continuous and let g : [0,1] > R be continuously differen- 
tiable. Prove that 


Jinn fo asevolea ott) [ soyae 


Let f : [0,1] + R be continuous. If lim,_,9+ fe) exists and is finite, show that 
for any continuous differentiable function g : [0,1] > R, 


ee ae eee iO 
fim nf o(e)saae =a) [Pa 


Remark. A class of limits are direct consequences of this principle. For example, 


1 72 1 gr-2 ss 
im nf f(x) In(l +2 )dx = > f(1), jim nf pega ay 
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68. 


69. 


70. 


71. 


72. 


73. 


74. 


79. 


76. 


Integration 


Let f : [0,1] > R be continuous. Show that 


fief 2) = f(x 
noo Jig 1+n?2cos2 x 


Let f : R-R be a continuous periodic function with period 1. Prove that, for 
irrational number a, we have 


lim 7 (fla) + fa) ++ F(na)) = f haan 


nc nN 


Let f : [0,1] > R be integrable. Prove that 


lim ‘-2")"f (o)de= f° f(a) ar 


n—->co 0 


Let f : [0,1] — (0,00) be continuous. Find 


Jim if (1+ 2")" f(a) dx. 


Let f : [1,co] > R be a continuous function such that lim... xf(x) exists and 
is finite. Show that lim,_,., fr $@) dep exists and for any a > 1, 


a t 
lim nf f(a" )dx = tim [ f(@) 
noo 0 t-0o 1 x 


If f and g are nonnegative and integrable on [a,b], prove that 


b b 
lim / Vf" (a) + 9" (a) a= | max{ f(x), g(a)} da. 


n—->co 


Let f be a positive continuous function on [0,1] with f(0) = 1. Let g(x) be 
continuous on [0,1]. Prove that 


lim n? (f VIE al0) ae — ale) de) = g(1) [ BL) a 


Nn—- Co 


(Monthly Problem 11941, 2016). Let L =limn +f, */c” + (1 — 2)" de. 
(a)Find L. 
(b)Find 
1 
lim n? @ Var + (1— 2)" dx — t) : 
noo 0 
Let L = lim, 5.6 po Vsin” x + cos” « dex. 


(a)Find L. 
(b)Find 


n/2 
lim n? (/ VET COG 1) 
noo 0 
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77. 


78. 


79. 


80. 


81. 


82. 


83. 


84. 


(Monthly Problem 11535, 2010). Let f be continuously differential function 
on [0,1]. Let A = f(1) and let B= Se a—/? f(x)da. Evaluate 


lim n ( [som f(a “->( a) (SP) 


in terms of A and B. 


(Frullani Integral). Let f : [0,1] + R be continuous and let 0<a<b< 1. 
Show that F . 
— f(b b 
[Sa con pom? — f’ Fa 
0 x a a x 


(Monthly Problem 11548, 2011). Let f be a twice differentiable real-value 
function with continuous second derivative, and suppose that f(0) = 0. Show 


that ‘ F 
[ utteyPae > 10 ( ik fe)de) 


(Monthly Problem 11517, 2010). Let f : [a,b] > R be three-times differen- 
tiable with f(a) = f(b). Prove that 


(a+b) /2 b 
i fede ‘| fade 
a (a+b) /2 


(Monthly Problem 11417, 2009). Let f : [0,1] — R be continuously differ- 


entiable such that fea f(x)dxz = 0. Show that 


i *(P(a))Pde > 27 ( i; f(e)dr) 


(Monthly Problem 11946, 2016). Let f : [0,1] — R be twice differentiable 
with f” continuous on [0,1] and ee f(x)dx = 0. Prove 


4860 a f(x) i) <1 if (f(xy)? de. 


(Monthly Problem 12229, 2021). Let f : [0,1] ~ Rbea ae vm has 
a continuous second derivate and that satisfies f(0) = f(1) and a a f(x)dx = 0. 


Prove 
1 
30240 af(x) dx 
([ «s(eyar) 


(Monthly Problem 11133, 2005). Let f be a nonnegative, continuous, concave 
function on [0,1] with f(0) = 1. Prove that 


af ? f(a) Jar + 5<(f te ye) 


2 


= sup fe 
192 x€ [a,b] | “ N- 


2 


2 


< i “(U"(a))? de. 


272 


85. 


86. 


87. 


88. 


89. 


90. 


91. 


92. 


93. 


Integration 


(Putnam Problem 1940-A3). Find f(x) such that 


[ rwa=(f fle)de) 


when constant of integration are suitably chosen. 
(Putnam Problem 1968-A1). Prove that 


yy) Leer a 4 
Zar= | a el a 
7 0 1l4+2? 


(Putnam Problem 1987-B1). Evaluate 


/in(Q — 2) 
a — 2) oes 


(Putnam Problem 1991-A5). For 0 < y < 1, find the maximum value of 
y 
| Vxtt (y — y?)? da. 
0 


(Putnam Problem 2014-B2). hee that f : [1,3] > R is a function such 
that —1 < f(x) <1 for all x and if x) dx = 0. How large can i. f f@) dx be? 


Find all continuous functions f : R—- : such that 


a+1/n 
wf " f(t) dt =nf(«) + = 


for alla €R,neEN. 


Find all continuous function f on (0,00) such that 


- fyar= fr f(tj)dt  foralla>0. 


Let a € [0,1]. Find all continuous functions f : [0,1] > [0,00) such that 


[ se) a= 1, [ entoyae =i; [ ieee =a’. 


(Monthly Problem 11981, 2017). Suppose that f : [0,1] — R is differentiable 
function with continuous derivative and with 


[ teyar= f 2fe)ar= 
fur (0) | dx > (2) 


Hint. First show that fo 2( x(1—2x)f'(x) dx = 1. 


Prove 


Exercises 


94. 


95. 


96. 


97. 


98. 


99. 


Let f be twice continuously differentiable and positive on (0,1). If f(0) = f(1) = 


0, show that 
[ f'(z) 
o | f(z) 
Remark. An elegant solution due to Larson can be found in [63, pp. 238-239]. 
Similar to the solution of Problem 22 in this Chapter, you may give another 
proof. Hint: Let f(ao) = maxzejo,1) f() for some x € (0,1). Then f’(ao) = 0. 
Furthermore, show that 


dx > 4. 


fan) Se [ois@las and fo) < (10) ff") ae 


(Monthly Problem 12193, 2020). Suppose that f : [0,1] > R has a continu- 
ous third derivative and f(0) = f(1). Prove 


k—1)k!(k—1)! 
“1 =)" tr < ( wah ( DI 1) qnax, \f'” (x)|, 


where k is a positive integer. 
Suppose that f : [0,1] > R is differentiable. If a,b € (0,1),a < b such that 


7. tow Molde 


(2) do] < 4 = 


show that 


where M = maX,¢(0,1) |f'(a@ I 


Let f be twice continuously differentiable on [a,b]. Prove that there exists € € 
(a,b) such that 


[ sear = 6-07 (44) 4 EX pre, 


Let f be differentiable on [a,b]. If f(a) = f(b) = 0, prove that there is a x9 € (a,b) 
such that 


| f’ (xo) 12 Goo 


In addition, if f(x) is not identical zero on 7 b], show that there is a xo € (a,b) 
such that 


b 
(ool > Goae flac. 


Let f be differentiable on [a, b]. If f((a+b)/2) = 0, prove that there is a x9 € (a,b) 
such that 


/ 4 
ed? poop | IM lae= Gs 


Find an example that there is no 29 € (a,b) such that 


b 
ol > Goa flac. 
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100. Let f be twice continuously differentiable on [a, b]. If f(a) = f(b) = 0, prove that 


(b—a)° 
2 


x) dx) < 


Hint: First show that 


[ f(x) dz = ah (x — a)(x — b) f"(x) dz. 


101. Let f : [a,b] > R be continuously differentiable. Show that 


ana [f(a nl <p =| 0 ) de +f rele 


102. Let f : [0,1] > R be a continuous function which satisfies x f(y) + yf (a) <1 for 
all x,y € [0, 1]. Show that 
[ te 


Find a function satisfying the equality. 


nae 


103. (Niven’s proof on irrationality of 7). For a,b,n € N, let f(x) = 4a"(a—br)”. 


Prove that 


(a) f(a/b— x) = f(x), 
(b) f® (a OS Boral SRS hand Oa: 
(c) Assume that 7 = ¢, a and b are relatively prime. Show that 


fi f(x) sina dx € Z. 
0 
(d) Show that 


m< 1 (for sufficiently large n). 


is f Hashede ee 
0 n! 
104. Show that e is irrational. 


105. Let f be continuously differentiable on (0,1). If f(0) = f(1) = 0, prove that there 
exists a positive constant M such that 


[ Pousm fi 


Try to determine the best possible constant M in the above inequality. 


106. Let f be twice continuously differentiable on (0,1). If f(0) = f(1) = f’(0) 
0, f’(1) = 1, show that 


i: (f(a)? de > 4. 
0 


Find the condition for which function(s) the equality holds. 


Exercises 


107. 


108. 


109. 


110. 


111. 


112. 


113. 


114. 


115. 


Let f be continuous and increasing on [a, 6]. Show that 


b 
[ uf (x) dx > at i f(x) dz. 


Let f be integrable on [0,1]. If 0 <m< f(x) <M for all x € (0, 1], show that 


: ' dz (m+ M)? 
1s fl seas. fy $< aa 


Let f be continuously differentiable on [0,2]. If f(0) = f(2) = 1 and |f’(x)| <1 
for all x € [0,2], show that 


ey f(x) dx < 3. 
0 


Let f be continuous on [0,1] and 0 < f(x) <1 for all « € [0,1]. Show that 


'  f@)_ 4,5 Jo F(a) de 
I T—F(@)° . 1— fo fla)dx 


Show that there is no integrable function f that satisfies 
TT TT 3 
i (f(a) —sing)?dx<— and | (f(x) — cos x)? dx < —. 

0 4 0 4 
(Bellman Inequality). Let f,g, and x be nonnegative continuous function on 
[to, ti]. If 

t 
x(t) <9t) + f f(s)e(s)ds, to St Sh, 
to 


prove that 
t 
a(t) < g(t) + / Hls)g(s)el 10 ds, to <t< ty. 
to 


Let f be continuously differentiable on [a,b] and let g be convex on [a,b] such 
that f(a) = g(a), f(b) = g(b), and f(a) < g(a) for all x € (a,b). Prove that 


b b 
[ vis G@Pas f VIF e@Pa. 


Prove that = 
‘ e892 dae > ge e2/™, 
0 
Find a sharper lower bound for this integral. 
Let f be continuously differentiable on [a,b] such that f(a) = f(b) = 0. Prove 
that : 
fP?(@) 
4d? (x) 


where d(x) = min{x — a,b — a}. 


b 
dx < / (f'(«))? der, 
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Sequences and Series of Functions 


It is not once nor twice but times without number that the same ideas make their ap- 
pearance in the world. 
— Aristotle 


All intelligent thoughts have already been thought; what is necessary is only to try to 
think them again. 
— Johann Goethe 


Since many important functions are defined by using infinite sequences or series, in this 
chapter, we extend the study of numerical sequences and series to the study of sequences 
and series of functions. Given a sequence or series of functions, it is often important to 
know whether or not certain desirable properties of these functions carry over to the limit 
function. In analysis parlance, we want to know if each function in a sequence or series 
of functions is continuous or differentiable or integrable, can we assume then that the 
limit function will be continuous or differentiable or integrable? The intuitive answer is 
“Yes, why not?” For example, for the case of integration, if f, is very close to f, then its 
integral (the area under the curve) should be close to that of f. However, the Examples 
6.1-6.4 in the following section show that these desirable properties are not inherited by the 
pointwise limit functions. Hence pointwise limits do not behave nicely enough for analysis. 
In a manner reminiscent of uniform continuity, we introduce Weierstrass’s stronger form of 
convergence—uniform convergence, and illustrate its nature and significance. 


6.1 Pointwise and Uniform Convergence 


Not every soil can bear all things. — Virgil (19 B.C.) 


Recall that, in Chapter 2, the convergence of infinite series is defined in terms of the 
associated sequence of the partial sums. Along the same lines, we initially study the behavior 
and properties of converging sequences of functions, the results from our study of sequences 
can be immediately applied to the series of functions via the n partial sums. 

Let f(x) be a sequence of functions each defined on an interval J C R. Observe that 
fn(o) is a numerical sequence for each given xo € I. 


Definition 6.1. For each n € N, the sequence of functions f,(a) : I — R converges 
pointwise to f(x) on I if for each xp € I the numerical sequence fn(xo) converges to f(x). 


Thus, in e — N language, for every € > 0,29 € I, there exists an N(2o,¢) € N such that 
\fn(%o0) — f(@0)|<e€ whenever n> N. 


Example 6.1. Consider f,(x) = x” on [0,1] (see Figure 6.1). We have 
: 0, f@O<a<l, 
im fate) = Fee) ={ PH 


jim. 1, fen pointwise. 
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1.0 


0.8 


0.6 


0.4 


0.2 


0.2 0.4 0.6 0.8 1.0 


FIGURE 6.1 
fn(x) = x” for n = 1,2,3,4, 100. 


Let xo € (0,1). For every « > 0, choose N > (Ine/In zo) yields that, ifn > N, 
|fn(ao) — f(ao)| = 2G < a’ <e. 


The choice of N above depends on both ¢€ and xo. For example, let zo = 1/2,€ = 1/3. To 
achieve 


1 
[fn (1/2) — F(1/2)| < 3, 
we have N = 2. But if vp = 9/10, € = 1/3, 


\in(9/10) ~ f(9/10)| < 5 


holds only for n > N = 10. In general, there is no N such that | f,(#)—f(x)| < «whenn > N 
for every x € (0,1). In fact, if 1 > a, > 1/ 3, we have |fn(an) — f(an)| = 2% > 1/3 =e. 
This example shows that the pointwise convergence does not necessarily carry over the 
continuity to the limit function. 
The following generic Mathematica code enables us to animate the convergence: 


Animate[Plot[x*n, {x, 0, 1}, 
Prolog -> {Red, PointSize[0.01], Point[{1/n, 1/nn}]}, 
PlotRange -> {{0, 1}, {-0.1, 1}}], {n, 1, 15, 1, Appearance -> "Labeled"}] 


Example 6.2. Consider f,(x) = Qn2xe-"®” on [0,1] (see Figure 6.2). We have 


lim fn(x) = f(x) = 0 pointwise. 


Thus i. f(x) dx = 0. On the other hand, 


1 
3 : =n?) _ 
im, ; fn(x) dx = Jim (l-e" )=1. 


This example shows that, for pointwise convergence, in general, 


b b 
lim, fale) ax  f Jim, fn(x) da. 
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0.2 0.4 0.6 0.8 1.0 


FIGURE 6.2 a 
Fp(@) = 2n?ze-** on [0,1] for n = 2,4, 8, 10. 


Example 6.3. Consider f,(2) = x1t/@"-) on [-1,1] (see Figure 6.3). We have 


lim fp(x) = f(x) = |x| pointwise. 


n—->oco 


Since || is not differentiable at « = 0, this example shows that the piontwise limit 
function does not inherit the differentiability from the approximating sequence. 


Example 6.4. Consider f,(a) = Sune on R. We have 


lim fn(x) = f(x) = 0 pointwise. 


-1.0 -0.5 0.5 1.0 


FIGURE 6.3 
fa(z) = a't1/@"-) on [-1, 1] for n = 2,3, 4,00. 
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So f(z) is differentiable and f’(x) = 0. But, 
fi(z)=VJneosnt #0, «eR. 
This example shows that even though the limit function exists and is differentiable, 
lim, fia) # (lim, falx)) = F'(a). 


Examples 1—4 convinces us that pointwise convergence does not interact well with the 
concepts of analysis. Let us first try to gain an insight into a difficulty we must overcome if 
we wish to transfer continuity from the individuals f,, to the limit function f. Assume that 
each f,(a#) is continuous and f,(«) > f(x) pointwise. To argue that f is continuous at xo, 
let € > 0, we need to find a 6 > 0 such that 


| f(x) — f(ao)| <¢€ whenever |a — xo| < 6. 
By the typical “e/3 argument,” the critical inequality becomes 
If(@) — Flo) S |F(@) — fn(®)| + | fn(@) — fr(@o)] + fn (@o) — f (xo) < €- (6.1) 


The pointwise convergence asserts that, for n > N, 


\fn(#0) ~ F(0)| < 5. 
Now for N fixed, the continuity of f, implies that 
|fn(x) — fn(£o)| < 5 whenever | — 29| < 6. 
But here is the problem. We also need 
\fn(x) — f(x)| < 5 whenever |x — xo| < 6. 


The values of x depend on 6, which depends on the choice of N. Thus, we cannot go back 
and choose a different N. As Example 6.1 indicates, the number N that works for 7) may 
not work for x #4 x. To resolve this drawback, we would require that for each « > 0, there 
is an N €N such that 


Iin(e) — f@)< 5 for alle eI andn>N. 


Here N would depend on € but not on x. Thus, the values f, would be “uniformly” close 
to the values f(z). 

By 1841 Weierstrass recognized these phenomena exhibited in Examples 1-4 and first 
proposed the following stronger form of convergence—uniform convergence. As we will see 
in the next section, uniform convergence will allow us to transfer the key properties from 
individual functions to their limit function. 


Definition 6.2. For each n € N, the sequence of functions f,(a) : I — R converges 
uniformly to f(x) on I if for every « > 0, there exists an N € N such that 


lfn(a) — f(a)|<e foralla eT and for alln>N. 
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FIGURE 6.4 
fn(x) is within a € band of f forn > N. 


Similar to the phrase “uniformly continuous” in Chapter 3, the term uniformly emphasize 
the fact that the response N to a prescribed € can be chosen to work simultaneously for 
all x € J, i.e., one N fits all x in the domain of the functions f,. Geometrically, construct 
a band of radius € around the limit function f, if f, + f uniformly, then for every x € J, 
there exists an N € N such that f,,() is entirely contained in this « band whenever n > N 
(see Figure 6.4). 

Return to Example 6.1, in view of Figure 6.1, no matter how large n is, f,(a) = «” never 
completely falls within the band 0 < y < e< 1. So x” does not converge to 0 uniformly. 

Let fr(x) > f(x) pointwise. Define 

Wn = sup |fn(x) — f(#))- 


«cel 
This offers a typical procedure to test the uniform convergence for a large class of sequences. 


Theorem 6.1. f, — f uniformly on I if and only if 


lim w, =0. 
noo 


Proof. “= »” Suppose that f,(«) > f(x) uniformly on J. Then for every € > 0 there is an 
N = N(e) €N such that 


\fn(a) — f(@)|<e for all a € I whenever n > N. 


Thus 
ide = SUD |fn(z) — flz)| <e. 


This shows that limy_..5 Wn = 0. 
“<—=” Suppose that limy, +o. Wn = 0. Then for every « > 0 there exists an N = N(e) € N 
such that 
wr = sup |fn(x) — f(x)|<e€ whenever n> N. 
eel 


Since 
\fn(z) — f(x)|<wyn <e for all 2 € J whenever n > N, 


it follows that f,(#) > f(#) uniformly on I by the definition. 
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Example 6.5. Does f,(x) = Qn2xe-™ ® converges uniformly on [0,1]? 


In Example 6.2, we already knew that f,(2) > 0 pointwise. Since 


Wn = sup On2xe-” > fr(1/n) = 2ne! A 0, 
x€ [0,1] 


it follows that the convergence is not uniform from Theorem 6.1. 

When the limit function f(a) cannot be found explicitly, which is especially apparent 
when f, is a partial sum of a series of functions, uniform convergence can often be tested 
by the following Cauchy criterion. 


Theorem 6.2 (Cauchy Criterion). A sequence of functions fy(x) : I > R converges 
uniformly on I if and only if for every € > 0 there exists an N € N such that 


fn(x) — fm(x)| <€ 
for allm,n > WN and for alla € I. 


Proof. “=” Suppose that f,(«) > f(x) uniformly on J. Then for every € > 0 there is an 
N € N such that |f,(x) — f(x)| < €/2 for all x € I whenever n > N. Therefore, if m,n > N, 


we have é 


2 


|fn(x) — fm(@)| S |fn(x) — F(@)| + [F(@) — fm(@)| < 5 ae et 
for all x € I. 

“<=” Suppose that given every € > 0 there exists an N € N such that |fn(x)— fm(x)| < € 
for all m,n > N and for all x € J. Then for each xp € I, fn(ao) is a numerical Cauchy 
sequence and hence converges. Let its limit be f(ao). In this way a function f(x) is char- 
acterized by domain I and f,(2) > f(a) pointwise. We have to prove the convergence is 
uniform. Let ¢ > 0. There is an N € N such that |fp(a7) — fin(x)| < €/2 for every x € I and 
for alln,m > N. For each x € I there is an Nz > N for which | fn, (x) — f(a)| < €/2. Thus, 
if n > N, we have 
€ 


2 


=€E 


|fn(x) — F(@)| S |fn(@) — fr, (@)| + lf, (@) — F(a)| < = + 


for all x € I. Therefore f;,(a) converges uniformly to f(a) on I. 


Next we study the convergence of a series of functions by looking at the sequence of its 
partial sums. The pointwise and uniform convergence of a series are defined as follows. 


Definition 6.3. The series >>, fn(x) converges pointwise to f(x) on I if the numerical 
series \~_, fn(@o) converges to f(xo) for each xo € I. 


Remark. It is clear that the series 7, fn(x) + f(x) pointwise = > the sequence 
S,(«) = p_, f(z) > f(x) pointwise. 


Definition 6.4. The series >, f,(x) converges uniformly to f(x) on I if the sequence 
Sn(a) = op_, fe(x) converges uniformly to f(x) on I. 


Using the Cauchy criterion (Theorem 6.2), we have the following important applicable 
test for uniform convergence. 


Theorem 6.3 (Weierstrass M-test). Suppose that |fn(x)| < Mn for all x € I and for 
everyn EN. If 3, Mn converges, then Sy, fn(x) converges uniformly on I. 
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Proof. If S>°_, My converges, then, for every « > 0, there is an N € N such that 
remit Me < € whenever n > m > N. Therefore, for n > m > N and for all x € J, 


we have 
ISn() - Sm(z)|=| > fl@l< SD Me <e. 


k=m-+1 k=m+1 
Uniform convergence now follows from the Cauchy criterion. 0 


Clearly, the series on which the Weierstrass M-test is applicable must converge abso- 
lutely. However, there does exist series which converges uniformly but not absolutely. 


a0 eae 


Example 6.6. Consider the series \-~_, (<< on R. 


aztn 
By the Alternating series test (Theorem 2.8), this series converges pointwise on R. 
Appealing to the fact that an alternating series remainder |R,| < an41, we have 


1 1 


ce Cato? Z 
~ a@+tn+17 n+l 


[Rn(z)| = an 


k=n+1 


So the series indeed converges agate by the Cauchy criterion. Comparing with the 


diverges. Thus, )>°- CD" does not converge 


harmonic series, we see that }~~ Ne ore a 


absolutely. 
The following example shows that a series )~>-_, an(a) itself converges absolutely and 
uniformly, but }7°~_, |an(z)| does not converge uniformly. 


n=1 En 


(-1)"-1 4? 


Example 6.7. Consider the series pees 1 a on R. 


If x £0, we find that the alternating series remainder 


Sood (—1)*-1x-? 
» (1+ 22)F 


k=n+1 


x? x? 1 


= — : 
~ (L4+a2)rtl 14+ (n41)a24+---4 22+) ~ n+1 


|Rn(x)| = 


So the series converges uniformly on R. Since 


ss (= i= 172 => 
= (14+ a2)r = aa 


is a geometric series with the common ratio 1/(1 +2?) < 1, it follows that the series 


converges absolutely. However, the remainder of the series }>7_, Teo is given by 
Pe. a x?/(1 +4 eye 1 
Rn (x) = ¥ Dyk aS Dyn 
ca (1+ 2?) 1-1/1 +27) (1+ 2?) 


For fixed n, as z > 07, R,(x) > 1. Therefore, >>, ao 

When the Weierstrass M-test is not applicable, for example, the series is not absolutely 
convergent, which occurs in Fourier series frequently (see Example 2.14), we often turn 
to the Able’s and Dirichlet’s tests for uniform convergence. They are an extension of the 
corresponding numerical tests Theorems 2.25 and 2.26 by replacing these bounds with the 
uniform bounds (independent of x) and the convergence with uniform convergence. To be 
specific, in Abel’s test (Theorem 2.25), the condition that |am4i +--+: +dn| < € is replaced 
by the requirement that 


does not converge uniformly. 


lQm4i(@) +++++an(x)|<e  foralla eT. 
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This can be asserted by uniform convergence of )>>-_, a,(x) on I. Thus we have 
Theorem 6.4 (Abel’s Test for Uniform Convergence). Assume )>~~_, Gn(x) con- 
verges uniformly on I. If the sequence b,(a) is bounded and monotone, then 


Co 


An(x)bn (x) = ay (x)bi (x) + ao(x)bc@) + +++ + An(X)bn(x) ++>- 


B 


n= 
converges uniformly on I. 
Similarly, we have 


Theorem 6.5 (Dirichlet’s Test for Uniform Convergence). Assume the partial sum 
rei Gn(x) is uniform bounded on I. If the sequence b,(x) is decreasing and converges to 
0 uniformly on I , then 


S- An(#)bn (x) = ay(a@)bi (x) + ao(x)bc@) + +++ + an(X)bn(x) +++- 


converges uniformly on I. 


6.2 Importance of Uniform Convergence 


Cauchy ultimately recognized the need for uniform convergence in order to assert the 
continuity of the the sum of a series of continuous functions but even he at that time 
did not see the error in his use of term-by-term integration of series. — Morris Kline 


Equipped with the uniform convergence, we now prove three main theorems which 
demonstrate the compatibility of uniform convergence with the concepts of analysis. 


Theorem 6.6. If f, : I > R is continuous and fy, converges uniformly to f(x) on I, then 
f(a) is continuous on I. 


The key step of the proof is displayed in the critical inequality (6.1). We leave the details 
to the reader. Applying this theorem to the sequence of the partial sums of a series, we have 


Corollary 6.1. If f,: 1 — R is continuous and ~~~, fn converges uniformly to f(x) on 
I, then f(a) is continuous on I. 


The following consequence provides a simple test for nonuniform convergence. 


Corollary 6.2. Let f, : I > R be continuous, and let fr(x) > f(x) pointwise on I. If 
f(x) ts not continuous on I, then fr > f is not uniform. 


Let {r1,r2,...} be ordering rational numbers in [0,1]. Define 


_f 1, ifee {ri,re,...,Tn}, 
fn() = { 0, otherwise. 


The set of points of discontinuity of f, (a) is {r1,1r2,..-,%n} and so f, is Riemann integrable 
for every n. Clearly, f(x) converges to the Dirichlet function D(x) pointwise. It is well- 
known that D(x) is not Riemann integrable. Furthermore, Example 6.2 indicates that even 
if the pointwise limit of a sequence of Riemann integrable functions is Riemann integrable, it 
may happen that the integral of the limit function is different from the limit of the sequence 
of integrals. The following theorem shows that uniform convergence is sufficient to resolve 
this dilemma. 
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Theorem 6.7. If f,, : [a,b] > R is Riemann integrable and f, converges uniformly to f(x) 
on [a,b], then f(x) is Riemann integrable on [a,b], and 


n—>co 


b b b 
lim f(z) ax = f Jim fn(£) ax = f f(a) da. (6.2) 


Proof. We first show that f is Riemann integrable on [a,b]. For every « > 0, the uniform 
convergence implies that there is an N € N such that 


fale) — f(a) <5 ie for all x € [a,b] whenever n > N. (6.3) 
—a 
Since f, is integrable, there exists a partition P = {zo,21,...,%n} of [a,b] for which 
U(P, fu) — L(P, fu) < 5 
Let 
M:= sup f(x), m= inf f(a); 
r€ [241,21] ve [vi—1, 2%] 
M:= sup fn(z), m= inf — fr(a). 
xr€[xi-1,2i] ve [vi-1, i] 
By (6.3), we have 
€ = € 
My 4 S M; < M; 
3-4) > T3620) 


Hence 


This implies that f(x) is Riemann integrable on [a,b] by the Darboux Theorem. 
Next, we prove (6.2). For every € > 0, there is an N € N such that 


lfn(x) — f(x)| < — for all x € [a,b] whenever n > N. 
—a 


Thus, for all n > N, we have 


i fn(o) de — i f(x) de 


b b 
< f \fnle)-s@]aes f de =e 


The integrability of f can also be asserted by the Lebesgue theorem. Let D(f) and D(f,,) 
be the set of discontinuities of f and f,, on [a,b], respectively. By the assumption that f,, 


b 
/ (fae) — flee) de 
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is Riemann integrable, Lebesgue theorem implies that D(f,,) has measure zero. Moreover, 
since f,, > f uniformly, there is an N € N such that 


|fn (a) — f(x)| <1 for all 2 € [a, b]. 


In view of the boundedness of fy, this implies that f(a) is bounded. If 2 € D(f), then xo 
must be a discontinuity point of some f,. Otherwise, if f, is continuous at xo for each n, by 
Theorem 6.6, f is also continuous at x, which contradicts the assumption that x9 € D(f). 
Therefore, we have 

D(f) URE D(Ufn)- 


Since D(f,) has measure zero, it follows that US, D(fn) has measure zero and so D(f) 
has measure zero. This concludes that f is Riemann integrable by the Lebesgue theorem. 
Applying Theorem 6.7 to the sequence of the partial sums of a series, we have 


Corollary 6.3. If f;, : [a.b] > R is Riemann integrable and S~>~_, fn converges uniformly 
to f(x) on [a,b], then f(x) is Riemann integrable on [a,b] and 


[s@a= fy dS fale yaie= >of fale 


Similar to Corollary 6.2, we have another simple test for nonuniform convergence as 
follows. 


Corollary 6.4. Let f, : [a,b] > R be Riemann integrable, and let f,(x) > f(x) pointwise 
on [a,b]. If f is Riemann integrable, but 


lim fale) aot [hy lim_ fa(e) de 


then fn — f is not uniform. 


Example 6.8. Consider 


Clearly, f,(x) is continuous and f,, > 0 pointwise on [0, 1]. Since f(x) = 0 is continuous, 
it does not violate Corollary 6.2. However, we have limy,_,~ Ie fn(z) dx = 1 4 0. Thus 
Corollary 6.4 concludes that f, — 0 is not uniform on (0, 1]. 


Example 6.9. Consider 


2n2, O0<a< x 
fr(t)=4 21l-nz), #<a<e, 
0, ae as 1. 


Here we have f,, + 0 pointwise. The limit function f(x) =0 is continuous. Moreover 


b b 
lim ose \dx = / lim fn(x) dx 
n—->oco a noo 

but fn — 0 is not uniform because wy, = supzejo,1)|fn(x) — f(x)| = fC1/2n) = 1. This 
example shows that, for continuity of the limit function, uniform convergence is sufficient 
but not necessary. However, if f, is decreasing, the following theorem asserts that uniform 
convergence is also necessary for the continuity of the limit function. 
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Theorem 6.8 (Dini’s Theorem). Let f, : [a,b] > R be continuous and decreasing. 
Suppose that f, > f pointwise on [a,b]. If f is continuous on [a,b], then fy > f uniformly 
on [a, bj. 


Proof. We prove by contradiction. Assume that the convergence is not uniform on |a, b], 
by Theorem 6.1, we have 


Wn = sup |f,(x) — f(x)| = max (f,(z) — f(x))A0, asn—-oo. 
x€ [a,b] x€[a,b] 


Hence there exists a constant a > 0 such that for infinitely many n €N, 


max (fn() — f(x)) > a. 


«€ [a,b] 


For each n € N, since f,(a) — f(a) is continuous on [a,b], by the extreme value theorem, 
there is an x, € [a,b] such that 


max (fn(x) — f(&)) = fn(tn) — f(@n) > a. 


x€ [a,b] 


On the other hand, since x, € [a,b] is bounded, by Bolzano-Weierstrass theorem, there 
exists a subsequence xp, such that 2, > Xo € [a,b] with 


Using fn4i(%) < fn(x) on [a, 6], for every n < nz, we have 


fn(@ne) — f(@n,) > &- 
Now fixing n and letting k — oo, by the continuity of f, and f, we find that 


fn(xo) — f(xo) = a 


for all n € N. This contradicts the assumption that f, > f pointwise at xo. 


Recall Example 6.1 where f,,(x) = x” on [0,1]. Since the limit function is not continuous 
at x = 1, by Corollary 6.2, f, is not uniformly convergent. However, since f, is decreasing 
and f, — 0 pointwise on [0,}] for any 0 < b < 1, Dini’s theorem implies that f,, converges 
uniformly on [0, 6]. 

For a series of functions, applying Theorem 6.8 to S(x) — S,,(x) yields 


Corollary 6.5. Let f, : [a,b] > R be continuous and nonnegative. If S(z) = >, fn(x) 
is continuous on [a,b], then the series converges uniformly on [a, b]. 

The continuity condition on $(x) is necessary. Otherwise, f,(2) = 2"~'(1 — x) on [0,1] 
yields a counterexample. 

In contrast to continuity and integrability, proving differentiability is much trickier. We 
have already seen, in Examples 6.3 and 6.4, that even if f, — f uniformly and each f,, is 
differentiable, nothing promises that f/ — f’. To guarantee that the limit of the derivative 
is indeed the derivative of the limit function, we need to impose the uniform convergence 
on f(x). 

Theorem 6.9. Let f,, : [a,b] > R be a sequence of functions such that 


1. fn(Xo0) converges for some xo € [a, b], 
2. each fy, is differentiable on [a,b], 


3. fi (a) converges uniformly on [a,b]. 
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Then fn converges uniformly on [a,b] to a function f(x), and 


d 
© lim, fala) = f'(a) = im, © f(a). 
Proof. By the assumptions, for € > 0, there is an N € N such that 

| fn(%0) — fm(@o)| < 5 whenever n,m > N (6.4) 


and 
lf, (2) — fin (2)| < TCE for all x € [a,b] whenever n,m > N. 


This, together with the mean value theorem, yields 
(fn(x) — fm(@)) — (fr(t) — Fm(t))] S 


for any x,t € [a,b] whenever n,m > N. Since 


| fn (a) — fm(®)| < \fn(®) — fm(@)) — Fn(®0) — fm(%0))| + |fn(%0) — fm(2o)|, 
from (6.4) and (6.5), it follows that 


i = lx -—t| < ; (6.5) 


\fn(x) — fm(x)| <e€ for all x € [a,b] whenever n,m > N. 
By the Cauchy criterion, f,(2) converges uniformly on [a, b]. Let f(x) = limn+oo fn (x) for 
x € {a, bl. 
Given x,t € [a, b],t #4 x, define 


Fn t) — fn v f t) — f v 
que. gos 

—2 t—2x 
By the hypotheses (2), for each n € N, we have 

. _ gf 

lim gn(t) = fr (2). (6.6) 
The inequality (6.5) implies that 

lgn(t) — gm(t)| << =—-~ whenever n,m > N. 
2(b— a) 

So gn(x) converges uniformly for t 4 x. Since f,, converges to f, we have 

Jim, gn(t) = g(t) (6.7) 


uniformly fora <t<b,t #.wx. By (6.6), letting ¢t > «x in (6.7) yields 
: eee 7 
lim g(t) = lim f(z) 


as desired. 


As usual, the following corollary follows from applying Theorem 6.9 to the sequence of 
the partial sums of a series. 


Corollary 6.6. Let ~~~, fn be a series of functions on [a,b] such that 


1. 3, fn(xo) converges for some xo € [a, dj, 
2. each fr, is differentiable on [a, b], 
3. yO, f(x) converges uniformly on {a, b]. 


Then >, fn converges uniformly on [a,b] to a function f(x), and 


i (Zain) = 709-3 (gat). 
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6.3. Two Other Convergence Theorems 


We know what we are, but know not what we may be. — William Shakespeare 


In the previous section, we demonstrated that uniform convergence is sufficient for us 
to interchange limit and integration operations. In this section we consider two conver- 
gence theorems, which allow us to interchange the limit and integration operations without 
requiring uniform convergence. 

We begin with 


Example 6.10. Consider 


See Figure 6.5. 
We have f, > f(x) pointwise on [0,1], where 


1, «=0, 
fe) = { 0, O<a<l. 


Since f(a) is not continuous on [0,1], by Corollary 6.2, f, — f is not uniform on [0,1]. 


1.0 
0.8 
0.6 
0.4 


0.2 


f10(x) 0.2 f3(x) 0.4 = f2(x) (0.6 0.8 1(*).0 


FIGURE 6.5 
fn(x) on [0,1] for n = 1, 2,3, 10. 
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However, we do have 


lim fr(a) dx = lim 5 -o= / lim fn(x) da. 


n+00 Jo noo 2n q NIC 


Note that f, is nonnegative and monotone decreasing with limp... fn(z) = 0 for every 
x € [0,1] except at « = 0. It turns out that these properties allow us to interchange the 
limit and integration operations. This is captured in the following theorem. 


Theorem 6.10 (Monotone Convergence Theorem). Let f,, : [a,b] — [0,00) be a 
sequence of monotone decreasing functions such that 

1. fn is Riemann integrable for each n € N, 

2. fn 2 0 pointwise on (a,b). 
Then 


nm—->co 


b 
lim [| fn(x) dx = 0. 


Applying this theorem to the sequence of f(x) — fn(a), we obtain 

Corollary 6.7. Let f, : [a,b] + R be a sequence of monotone increasing functions such 
that 

1. fn is Riemann integrable for each n € N, 

2. fn(x) > f(x) pointwise on (a,b), 

3. f(a) is Riemann integrable on [a, b]. 
Then 

b b b 

lim fn(a) dx =} lim Fae) =| f(a) dx. 


n—- co 


This Monotone convergence theorem is usually presented within the Lebesgue integral. 
One might think that there is no proof in the context of Riemann integral. Indeed, the deep 
part of using the Lebesgue integral lies in establishing the integrability of the limit function. 
If we assume the integrability of the limit function, the proof of the monotone convergence 
theorem becomes elementary and can be done entirely within the Riemann integral. Here we 
present a proof based on the Lebesgue criterion of Riemann integrability (Theorem 5.11). 

We begin with Cousin’s lemma. Recall Definition 5.2. Assume that 


P={a=% <%<...<2, =b} 


is a partition of [a,b] with a set of tags c; € [aj-1,2;], for 7 = 1,2,...,n. Let 6 : [a,b] > 
(0,00) be a gauge function. We call this tagged partition to be 6-fine if 


[xi-1, xi] Cc (cj _ O(c), Ci + d(c)), fori =1,2,...,n. 


See Figure 6.6 for an illustration. 
The following Cousin’s lemma asserts that every gauge has a d-fine partition. In partic- 
ular, we have 


Theorem 6.11 (Cousin’s Lemma). Let C be a collection of closed subintervals of [a, 0] 
with the property that for each x € [a,b] there exists 6 = d(x) > 0 such that C contains all 
intervals [c,d] C [a,b] that contain x and d—c <6. Then there exists a partition 


P={a=% <%<...<2, =b} 


of [a,b] such that [a;-1,2;] € C fori =1,2,...,n. 
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FIGURE 6.6 
An example of 6 fine partition. 


Proof. The proof is by contradiction and is based on the nested interval theorem. Suppose 
that C does not contain a d-fine partition of [a,b]. Then, either [a, (a+ b)/2] or [(a+b)/2, b] 
has no 6-fine partition. Let us denote the half of [a,b] without é-fine partition by [ay, bi]. 
We continue this process inductively and obtain a sequence of nested intervals [a,,,b,] with 
by — Gn = (b— a) /2” > 0 as n > ov. By the nested interval theorem, there exists a point 
€ which lies in every [an, bp]. Since 6(€) > 0, there is an N € N such that bp, — an < 6(&) 
whenever n > N. This indicates that 


P= {an =% <€< 21 =bn} 


is a 0-fine partition of [an,b,]. This contradicts the definition of [an, by]. 


In view of the nature of C, it is indeed a closed covering of [a,b]. Similar to the Heine- 
Borel theorem, Cousin’s lemma can be restated that if a closed covering of [a,b] contains 
all “sufficiently small” closed intervals, then it must contain a partition of [a,b]. With this 
lemma, we are now ready to prove the monotone convergence theorem. 


Proof of Theorem 6.10. Since f1() is integrable on [a, b], there is a constant M > 0 such 
that 0 < fi(a) < M. For every n EN, let 


Dn = {x € [a,b] : fn(x) is discontinuous at x}. 


By Theorem 5.11, D, is of measure zero. Let S = US_,D,. Then S is of measure zero as 
well. Hence for € > 0 there are disjoint open intervals (ay, 8,,) such that 


Co 


a € 
S GURy (Gasba) and d(6n Or ag 

For each x € S, there is a unique interval (a,,,3,) such that « € (ay, Bn), this allows us to 
choose 6(x) > 0 for which 


(x iS (x), x Fle 6(x)) Cc (Qn; Bn): 


On the other hand, for each x € [a,b] \.S, since f,(x) > 0 pointwise, there is an N(e, 7) € N 
such that 
whenever n > N(e, x) 
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Using the continuity of fiy(e,2) at 2, we can find a 6(”) > 0 such that 


2(b — a) 


inteayly) < whenever y € (x — 6,2 +0). 


By the assumption that f,, is monotone decreasing, we have 


€ 


——— __ whenever n > N(e,x) and y € (x — 6,4 +0). 
2(b — a) 


We now have a gauge function d(a) defined on all [a,b]. By Cousin’s lemma, there exists a 
6-fine partition P of [a,b] with a set of tags c; € [w;-1, x], for 7 = 1,2,..., N. In particular, 
[vi-1, 21] C (4 —S(ci),c¢ + 4(ci)), fori =1,2,...,N. 


Let 
N. = max{N(e,c;) : i=1,2,...,N}. 


Then for n > N, and any tags d; € [w;-1, xi] C (cj — 0(ci),c; + 6(cG;)) for i = 1,2,....N, we 
have 


N 
O< » fr(di)(@i — %j-1) = S- Fin (di) (ai — %i-1) + S- fn(di) (wi — U1) 


indies i,di€[a,b]\S 


< >. M (a; -— 2-1) + x Ab ray tt) 


i,dieS i,d;€[a,b]\$ 
€ € 
M -(b = 
Moy a —a@) 
Therefore 
b N 
0< fle) de <aup4 flan —-a)} <e 

@ i=1 


Since € is arbitrary, we conclude that 


b 
lim | f(x) dx =0. 


n—-+>Cco 


We now turn to the second convergence theorem. Recall Example 6.9 in which f, — 0 
is not uniform on [0,1]. See Figure 6.7. 
Clearly, f, is not monotone neither. But f,, < 1 for all n € N. Moreover 


1 b 
lim fn(x) dz = lim = 0 =| lim fn(x) da. 
a n> co 


n+00 Joy noo 2n 


The following theorem reveals that the uniform boundedness allows us to interchange limit 
and integration operations. 


Theorem 6.12 (Bounded Convergence Theorem). Let f,, : [a,b] ~ R be a sequence 
of Riemann integrable functions such that 

1. fr(x) > f(x) pointwise on (a,b), 

2. f(x) is Riemann integrable on [a, b], 


3. SUPzE [a,b] |fn()| < M for all n with some positive constant M. 
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0.8 
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0.2 0.4 0.6 0.8 1.0 


FIGURE 6.7 
fn(x) on [0,1] for n = 1, 2,3, 10. 


Then 


N—- Co 


b b b 
lim fn(2) ar= | Jim fn() ax = f f(a) dx. 


Proof. Let gn(a) = |f(x) — fn(x)|. By the assumptions, we find that g,(a) is Riemann 
integrable and g,(x) + 0 pointwise. Moreover, gy, is uniform bounded since f,, is uniform 
bounded and f itself is bounded because f is Riemann integrable. Thus, without loss of 
generality, we assume that 


(i) O< fn < M for all n € N and for all x € [a, b], 
(ii) fn 2 0 pointwise on {a, }]. 


Now for each n and for all x € [a, 6], let 
F,(#) = sup{fn+e(2)}. 
By (i), F,() is well defined. Moreover, we have 0 < fr, < Fh, 
F(a) > Fr4i(x) — for all x € [a, 8), 
and for all x € [a,b], by (ii), 


Jim, F(a) = Jim, sup f(a) = Jim, fn(z) = 0. 
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By the monotone convergence theorem (Theorem 6.10), we have 
b 
lim F(x) dx = 0. 


TTS. a 
Therefore : ; 
0< tim | fr(a) da < tim [ F(x) dx = 0, 
which implies that 


n—->co 


b 
lim fn(x) dx = 0. 


As usual, applying this theorem to the partial sums of a series yields 


Theorem 6.13 (Bounded Convergence Theorem for Series). Let f, : [a,b] > R be 
a sequence of Riemann integrable functions such that 


1. 0, fn(2) > f(x) pointwise on (a,b), 
2. f(x) is Riemann integrable on |a, b], 
3. |e fn(x)| < M for all n with some positive constant. 


[ (Saw) @=¥ (f mere), 


Example 6.11. The derivation of Leibniz series 
— (-1)" te ad 
a See ae Bos 
Ae een A 3.5 7 


offers a perfect application of Theorem 6.18. 


Then 


Begin with the power series 


1 
mao Cg age eae (eyed: 


Let S;,(x) be the nth partial sum of the above series. By Leibniz’s test, we have 
0<S,(x) <1, for alln >1 and every x € (0,1). 
Thus, Theorem 6.13 enables us to integrate term by term to obtain 
1 1 ioe 
T 1 
—-= ——_ dr = —1)” 2n d 
ee 


1 1 
=| lim sy, dx = lim Sn(x) dx 
0 


n—->co n—->co 0 
n 1 oe) 
= lim d-u" f x" dz = deur f x” dz: 
n—->co 
n=0 0 n=0 9 
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The idea behind the above derivation yields the following generalization. The proof is left 
to the reader. 

Let fn : [a,b] + [0,00) be a sequence of Riemann integrable functions. If fy, is monotone 
decreasing and )\~_,(—1)""' fn(x) is Riemann integrable, then 


b / © oo b 
i (soe) dx = S0(-1)" / f(a) de. 


n=1 


6.4 Power Series 


In mathematics the art of proposing a question must be held of higher value than solving 
it. — George Cantor 


In this section, we study a special class of series of functions which are represented in 
the form of a power series: 


f(x) = S> nx” = ag + a2 + agar” + aga? +--+: (6.8) 
n=0 
or, more generally, 
Pla) = > an (a = a)” = a9 + (a = a) + a2 ~ a)? + a5 (0 - a)? + 
n=0 


For simplicity, our discussion will be centered on the case a = 0 without any loss of gener- 
ality. 

Historically, power series provided an infinite algorithm to represent general functions. 
The beauty of this type of series is that all of the relevant information regarding the con- 
vergence behavior of the series is encoded in the defining sequence a,. First, we try to 
determine the set of points « € R for which the resulting series (6.8) converges. Clearly, this 
set contains x = 0. In fact, this set has a very nice structure. 


Theorem 6.14. If a power series ae, Gnx” converges at some nonzero point xo € R, 


then it converges absolutely for any x with |x| < |xo|. 


Proof. Ifthe series \+° 9 anx} converges, then the sequence a,,zj is bounded. Let |aoz}| < 
M for all n € R. For every z € R satisfying |x| < |xo|, we have 


x |" call 
|anz”| = |anzg| |—] <M |— 
XO XQ 
Since |2/a9| < 1, the geometric series 
Co r n 
MIS 
n=0 *0 


converges. By the comparison test, 77° 9 @nx” converges absolutely. 


Let 
L= Jim sup Vani, R= tr (6.9) 
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Applying the root test, we see that )>°° 9 dnx” converges absolutely if |z| < R and di- 
verges if || > R. As a direct consequence of Theorem 6.14, the set for which a power 
series (6.8) converges must be either {0} only or R entirely or one of the intervals: 
(—R, R),[—R, R),(—R, R] or [—R, R]. The number R is called the radius of convergence 
of the power series. It is customary to assign R the value 0 or co to represent the set {0} 
or R, respectively. 

Regarding the uniform convergence of a power series, the Weierstrass M-test leads to an 
important consequence: 


Theorem 6.15. Let the radius of the power series 


be R>0. If0<a< R, then the series converges uniformly on [—a,a]. If R is infinite, 
then the series converges uniformly on [—M, M] for every M > 0. 


Proof. By the definition (6.9), if R is finite then 
lim sup 4/|anR"| = 1. 
noo 

Thus, for every € > 0, there is an N € R such that 


VlanR"|<1+e whenever n> N. 


If 0 < |z| <<a< R, let € = (a — |z|)/|z|. Then, for n > N, we have 


|| |x| a 
0/\anx”| = — V/la,R” —(1 =—<l. 
V |an& R Va [ee | + €) R 
Equivalently, 
(ay n 
n Ks < D 
la,x”| (5) 


Now, the desired conclusion follows from the Weierstrass M-test with M,, = (a/R)". 
If R is infinite, similarly, we have 


lim sup ¥/|an| = 0. 
n—->oco 
So there exists an N € N such that ~/|a,| <1/2M forn > N. If 0 < |a| < M, then 
1 
Vien < Bl et forn > N. 


Therefore, applying the Weierstrass M-test with M, = 1/2”, we shows that the series 
converges uniformly on [—M, M]. 


It should not be too surprising that Theorem 6.15 does not permit us to take uniform 
convergence all the way to x = R because the power series may not converge at x = +R. 
Even if R = o, i.e., the series converges everywhere, the following example shows that the 
convergence may not be uniform on R. 
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Example 6.12. Prove that )~°-_, 2” /n! does not converge uniformly on R. 
n=1 g 1] 


Proof. Let m =n -— 1. Consider 


v n 
ISa() — Sna(a)| = A 
Given 0 < € < 1, we have 
ISn(n) — Salm) = > 1B 


By the Cauchy criterion, S,,(x) does not converge uniformly on R. 


Observe that 


Jim, sup V/|an| = Jim, sup V/|an|n = Jim, sup { ae 
This implies that the radius of convergence of any power series is the same as the radius 
of convergence of the series of derivatives and the series of integrals as well. Thus, for 
each x € (—R,R), there is an interval xq € [—a,a] C (—R, R) in which the series, the 
series of derivatives and the series of integration all converge uniformly. By Corollaries 6.1, 
6.3, and 6.5, we conclude that a power series will always be continuous, differentiable, and 
integrable on (—R, R). Moreover, the differentiation and integration can always be done by 
differentiating and integrating term-by-term. 

But what happens at the endpoints? Does the good behavior of the series on (—R, R) 
necessarily extend to the endpoint + = R? If the series converges absolutely at x = R, The- 
orem 6.15 is still applicable and concludes that the series converges uniformly on [—R, R]. 
So the remaining question is what happens if the series diverges or converges conditionally 
atr=R. 

First, we assume that the power series diverges at « = R. The following theorem shows 
that even though the series converges in (—R, R) the convergence is not uniform. 


Theorem 6.16. If anor Gynx” diverges at x = R, then the convergence of the series on 
(—R, R) is not uniform. 


Proof. By contradiction, we assume that the convergence is uniform on (—R, R). Thus, for 
every € > 0, there exists an N € N such that 


[Sn(t) — Sin (2)| = lamgiz™** + ampor™?? + +--+ an2"| <e€ 
forn >m > N and every « € (—R, R). Letting « > R~ yields 
[Sn( RB) — Si(R)| = lami Re + ampgR™ +--+ +a, R"| <e 


whenever n > m > N. By the Cauchy criterion on the numerical series, )>7° 9 anx" con- 
verges at x = R, which contradicts the assumption. 


Next, we assume that the power series converges conditionally at « = R. Notice that if 
a power series converges conditionally at « = R, it may diverge at x = —R. For example, 
the series >>, cy" xz” with R = 1. To focus our attention on the convergent endpoint, 
we will prove uniform convergence on [0, R]. The proof offers a nice application of Abel’s 


test for uniform convergence (Theorem 6.4). 
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Theorem 6.17. [f 0°) anz” converges at x = R, then it converges uniformly on [0, R]. 


Proof. Rewrite the series as 
co co x n 
nm Ae — 
2, aot =D ak (S) - 
Let 


Agra He Be (<). 


By the assumption that pear a, R” converges, it also converges uniformly. Since 0 < x < R, 


it follows that 
mt+1 m+2 m+3 
12 (D2 (Hs Gl 2-20 
R R R 


Applying Abel’s test to 07°, AnBn establishes the uniform convergence of the series on 
(0, RI. 


In summary, Theorems 6.15 and 6.17 demonstrate that if a power series converges point- 
wise on an interval J C R, then it converges uniformly on any closed interval containing 
in J. Combining this with Corollary 6.1, Theorem 6.17 yields a very useful consequence for 
power series. 


Theorem 6.18 (Abel’s Continuity Theorem). Let R > 0 be the radius of convergence 
of Pg nx”. If the series converges at x = R, then >” 9 anx™ is continuous on (0, R] 


and 
Co loc) 
lim y aga" = anR”. 
=0 n=0 


xz—>R- 
Recall that 


= (ee) a n 1 1 3 
In(l+a)= 5 ———_ 4 =E- zat ae —-+++ for |a| <1. 
n 
n=1 


Here R = 1, for x = 1 the series converges by the alternating series test. Thus the series 
represents a function that is continuous at x = 1. In particular, we have 


1 1 1 
yl, ee ea 
In2 473 ries 


The following example exhibits another more sophisticated application of Abel’s conti- 
nuity theorem. 


Example 6.13. Show that 


eee eS 
y= E(ina. a) 


Proof. We consider the power series 


I() = Da antt® oe, 
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This enables us to convert the series into a geometric series after differentiation. Clearly, the 
series has the radius of convergence R = 1. Moreover, the alternating series test concludes 
that the series converges at x = 1. Thus, apply Abel’s continuity theorem, we have 
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= 38n4+1  251- 3n4+1 217 x17 
= lim : f(t) dt = lim i y-8)" dt = lim ae 
a (0) fn 0 n=0 x17 (0) 1+ 38 


-[ dt -if be 28 
di AEB Sh AIR PSE 


Here the term by term differentiation for f’(t) is justified by Theorem 6.15 with R = 1. 


Instead of starting with a power series, if we start with a function f with derivatives of 
all orders at x = 0 and formally define a power series 


CO 
f(x) = ye an ce 
n=0 
then the coefficients a, must be given by 


_ £) 


an | 
ne 


By Definition 4.5, this power series is the Taylor series for f at x = 0. Cauchy’s counterex- 
ample 


0, if¢ =0, 
sa) =| Oat ifx £0 
shows that the Taylor series may fail to converge to the original function. This phenomenon 
shows that not every function with derivatives of all orders has a power series (Taylor series) 
representation. The following question naturally arises: Is a given power series the Taylor 
series for some function? 


First, we see the answer is yes for a power series with positive radius of convergence. To 
this end, if 


fe) => age” 
n=0 


has radius of convergence R > 0, then f(a) has derivatives of all orders in (—R, R) and 


Co 


f(a) = S2 n(n=1)-++(n—k+1ana”™. 


n=k 
In particular, we have f”) (0) = klag or 


_ f(0) 
kl 


ak 


This implies that the series itself is exactly the Taylor series of f(x). 
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What happens when a power series like Sa nla” converges at « = 0 only? Gelbaum 
and Olmsted [44] showed that }>*°, nla” is indeed a Taylor series. As somewhat of a 
surprise, based on this result, Meyerson [69] asserted that 


Theorem 6.19. Every power series is a Taylor series! 


Proof. We show that given any sequence a,, € R, there is a function with its Taylor series 
rg Gnx”. For n € N, define 


ann!, if |a| < ae 
gn(2) = a Ce 
0, fle] > Gece) 


and elsewhere as a “smoothing function” which is monotone in each interval where it is 
defined and which makes all derivatives of g, exist. Let fo = go and 


fn(tn) = 7 | ie f | 9n(xo)dxodaxy -++d@n_1.- 
0 0 0 0 


iy Gn (t)dt 4) ann dx <1. 
0 0 


Thus integrating n — k — 1 times yields 


then for n > 1, 


Lf"? (2)| = 


ae 


(n—k—1)!’ where 0 <k <n-—1 and fO (x) = fr(2). 


JAN? (@)| < 
By the Weierstrass M-test, )>>° 9 fF (x) converges uniformly on every bounded interval. 
Hence S74 fn(x) converges to some f(x) and f(x) = 7°, F) (a) for all k € N. Since 
oe (0) = ayn!onx, it implies that f™ (0) = ann!. 


Remark. The function with the given Taylor series is not unique. Indeed, for f as above 
and for every a € R, let 
2 
g(x) = f(z) +aeV* 
if ¢ £ 0 and g(0) = f(0). Then g and f have the same Taylor series at x = 0. Therefore 
there are uncountably many functions with any given Taylor series. 


6.5 Weierstrass’s Approximation Theorem 


Mathematicians do not study objects, but relations among objects; they are indifferent 
to the replacement of objects by others as long as the relations don’t change. Matter is 
not important, only from interests them. — Henri Poincaré 


Observe that if f is defined by a power series with radius of convergence R > 0, Theorem 
6.15 asserts that f can be approximated uniformly on [a,b] C (—R, R) by polynomials—the 
partial sum of the power series. Since not every function can be represented by a power series, 
naturally, we want to know what other class of functions can be approximated uniformly 
by polynomials. With his nowhere differentiable continuous function, Weieistrass (1872) 
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demonstrated how wild a continuous function can be and how far it is from being smooth. 
It would seem that a continuous function could not be in this class. But, Weieistrass made 
the case for uniform convergence again. As an affirmative answer to the question above, 
his following theorem provided a fortuitous connection between continuous functions and 
polynomials. 


Theorem 6.20 (Weierstrass’s Approximation Theorem). Every continuous function 
on [a,b] can be uniformly approximated by polynomials on [a, 6]. 


The original proof (1885) by Weierstrass is “existential” in nature—it begins by express- 
ing f(x) as a convolution 


fee) = jim ef sees | wl ay 


with the Gaussian heat kernel, and relies heavily on analytic limit arguments. Here we 
present Bernstein’s beautiful proof. Philip J. Davis says that “while Bernstein’s proof is 
not the simplest conceptually, it is easily the most elegant.” One of the nice features of 
Bernstein’s proof is that the approximating polynomials will be given explicitly. Such poly- 
nomials are important theoretically and have been applied in computer-aided design (CAD) 
and scientific computing [23]. 

We begin with introducing the Bernstein polynomials and proving some preliminary 
facts about these polynomials. 


Definition 6.5. Let f be a function defined on [0,1]. For n > 0, the polynomial 


En) (ror 


is called the nth Bernstein polynomial of f. 


This definition was motivated by probability theory. Indeed, consider a series of trials 
of tossing a coin. In each trial, we assume the coin has probability x of getting heads. 
In n tosses, the probability of the event that the n trials result in exactly k heads is 
(7)a*(1—2)"~*. By the binomial theorem, we have 


S- @ a*(1—a2)"-* = [2+ (1—2)]" =1. (6.10) 


k=0 


Now let X be the number of heads in a series of n trials. As a “random variable,” X/n is 
the ratio of heads to the total number of trials, and it takes the values {0, 1, vive, pS ne 
expected value of X/n is by definition 


E[X/n] = > x -P(X=k) => x (1) e®(1—2)"-*, 


k=0 k=0 


In general, the expected value of f(X/n) is equal to 


i(X/n) -G ) (eta —2-* = BaD. 


Figure 6.8 shows that the graphs of f(r) = \/z and a few Bernstein polynomials of f 
on [0, 1]. 
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FIGURE 6.8 
f(x) = Vz and B,(f) with n = 2,3, 10. 


By the definition of B,(f), (6.10) implies B,,(1) = 1. Moreover, 
Theorem 6.21. For x € R andn> 0, we have 

1. Bylo) = Chay E()2*( —ayr# =o. 

2. Bu(a®) = Ytao (B)” ()at(L — ay k= OE + 


3. Dio (HE — 2)” (Rak — a)e-* = 2), 


Proof. Recall the binomial theorem 
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n 


» @ why" * = (x +y)". 


k=0 


Differentiating this identity with respect to x yields 


. n -1,n- n— 
sue type ala ty), 
k=0 


Multiplying «/n on both sides results 
“ki 
eee =a2(r+y)"". (6.11) 


Letting y = 1 — = in (6.11) proves the identity (1). 
Next, differentiating (6.11) with respect to x, then multiplying x/n on both sides yields 


3 (‘) : (") phynk — Mo Veet ye? | ty) le (6.12) 


k n n 
k=0 


Letting y = 1 — = in (6.12) proves the identity (2). 
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Finally, since 


3 (; - “) @ a*(1—a)"~* = B,(x?) — 22By(x) + 27Br(1), 


the identity (3) now follows from (6.10) and the identities (1) and (2). 


We now return to the proof of Theorem 6.20. We may assume that [a, b] = [0, 1]. Because 
if the theorem is proved on [0,1], we say that there are polynomials p,(«) > f uniformly 
on [0, 1]. If g(x) is continuous on |[a, b], then 


f(z) = gat (6— aja) 


is continuous on [0,1]. Let dn(x) = pn (<2). Then @n(x) : [a,b] > R is a polynomial as 


b-a 


well. Moreover, 


dn(x) — g(x) = Dn (G2) f (F=) +0 uniformly on {a, 0). 


Bernstain’s proof... Since f is uniformly continuous on [0,1] by Theorem 3.7, for any € > 0, 
there is a 6 > 0 such that 


lf(z) — f(y) < - whenever |x — y| < 6 and x,y € [0,1]. (6.13) 


Let B,(f) be the nth Bernstein polynomial of f. Then 


Baste) Fla) = 4 (4) (eta = ay = fo ys (") stay 


(4 (=) = fe) (1) a*(1—2)"-*, 


To estimate this sum, for the 6 given in (6.13), we divide the set {0,1,2,...,n} into two 
subsets 


eA={k:0<k<n;|a—k/n| < 6} and 
e B={k:0<k<n;|x—k/n| = 5} 
For & € A, in view of (6.13), we have 


> |(#(Z) - #))| Qeta-or < ms (*) stay 


keEA 
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For k € B, let M = maxzepo,1) | f(x)|. We have (k/n — x)? > 6? and 
E|(¢() -s)] (t)ta-arts Sam (sta ar 
#e(t-) (err 
2M 3 (k as : 
cu S (£2) (tuo 


< 
—~ 2n62’ 


where we have used the identity (3) in Theorem 6.21 and the fact that x(1— 2) 
€ [0,1]. Since the 6 in (6.13) does not depend on the choice of x, let N > <4. When 


n > N, we have 
k n 
(-(t)-10)| (Jour eh 


De 


keB 


In summary, we have 


This proves that B,(f) > f uniformly. 


Since the proof used the fact that a continuous function on [a, b] is uniformly continuous, 
Weierstrass’s approximation theorem fails on non-closed intervals or on unbounded intervals. 
For example, f(a) = 1/ax can’t be uniformly approximated by polynomials on (0, 1) or (0, 1], 
otherwise, it would be bounded on (0, 1) or (0, 1], which contradicts that f(a) is unbounded 
on (0,1) or (0, 1]. This function serves as a counterexample on [1,00) as well. Suppose that 
f(x) = 1/x can be uniformly approximated by polynomials. Let « = 1. Then there is a 
non-constant polynomial P(x) such that 


1 
——P(«x)|<1, for all x € [1, oo). 
x 
Hence ‘ ; 
|P(x)| < P(x)}+—<14+1=2, forall z€[1,o), 
x x 


which is impossible. 
As one application of Weierstrass’s approximation theorem, we have 


Theorem 6.22. Let f be Riemann integrable on [a,b]. Then for any € > 0, there exists a 
polynomial p(x) such that 


b 
/ \f(2) — p(x)| de <. 
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Proof. By the assumption that f(a) is Riemann integrable on [a,b], Theorem 5.4 implies 
that there is a partition of [a, b] 


P={a=% <%1<-+:-<a2, = 0} 


such that 
Yoo wi(f)Aa; Ss 7 


We define a function g(a) on [a, b] as ‘ies 


g(x) = f (aii) 4 P(@s) = flei-a) (w—aj-1), fori=1,2,...,n 


Li Li-1 


Geometrically, g(x) is the line segment which connects the points (#;_1, f(vj;_1)) and 
(xi, f(w;)) for 7 = 1,2,...,n. Then 


[ lte)-s@|ae => [| F(@) - ate)]ae 


< oS Ee . lo F(t) — f(@0)) + (1 — a) (F(0) — florea)| de (« : =) 
sof" (aw, + (1 — a)we) Jae = Yell faz: < 5. 


On the other hand, since g(x) is continuous on [a, b], by Weierstrass’s approximation theo- 
rem, for the € given above, there is a polynomial p(x) such that 


|g(x) — p(x)| < aba) for all x € [a, }j. 
Therefore 
b 
[ te) v6 ohaes fs he anne la(2) — p(x)| de 
= 2 tap —a) (b 


Let f(@) = limn—oo Bn(f)(x). Must limp. BY (f)(x) = f'(x)? The answer is no, since 
there are plenty of continuous functions that are not differentiable. However, we have 


Theorem 6.23. If f is continuously differentiable on [0,1], then BL (f) > f'(x) uniformly 
on [0, 1]. 


We leave the proof to the reader. 


6.6 Worked Examples 


Keep in mind that there are millions of theorems but only thousands of proofs, hundreds 
of proof blocks, and dozens of ideas. Unfortunately, no one has figured out how to trans- 
fer the ideas directly yet, so you have to extract them from complicated arguments by 
yourself. — Fedja Nazarov 
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sin nx 


Determine whether or not 07°, 2 


converges uniformly on [0, 27]. 

Solution. In Example 2.14, by Dirichlet’s test, for every x € [0,27], the series 
converges pointwise. However, the convergence is not uniform. In fact, let 2, = 
m™/4n. We have 


sin(n + 1) _ sin 2n7z, 
|S2an(n) — Sn(tn)| = 4 fsigstel at 7 
sin(m/4) 1 


Dre * aD 


By the Cauchy criterion, this shows that the convergence is not uniform. 


Prove that f(x) = 07°, ne~”” is continuous on (0,00). 
Proof. Let a,(x) = ne—"*. Then 


sup dn(x) > an(1/n) =~ 40. 
@E(0,00) € 


Thus a,,(x) does not converge to 0 uniformly and so the series does not converge 
uniformly on (0,00). Here we cannot assert the continuity of f on (0,00) by 
Corollary 6.1. To make up for this gap, for any xo € (0,00), there is a 6 such that 
0 <6 <a. For every x > 6, if n is sufficiently large, we have 


fe ane Crs as 

n 
Since S~, 1/n? converges, by the Weierstrass M-test, it follows that 
yr, ne~"” converges uniformly on [6,00). Applying Corollary 6.1 now yields 
that f(a) is continuous on [d,co). In particular, f(a) is continuous at xo. Since 
xo € (0,00) is arbitrary, this concludes that f(x) is continuous on (0,00). 


Construct an example of a series which converges uniformly but fails by the 
Weierstrass M-test. 


Solution. For n € N, let 


Ll ose id 1 
Gn(2) = nD Sy SOS 
0, elsewhere 


For every given x € {0, 1], there is only one nonzero term in )>~-_, an(x), so the 
series converges pointwise on [0,1]. Since the remainder 


for all x € [0,1], it follows that the convergence is uniform on [0,1]. On the other 
hand, notice 


sup an() = — 
x€([0,1] n 


and the harmonic series is divergent, thus the Weierstrass M-test is not applicable. 
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4. Let f(a) be twice continuously differentiable on (—n,7) for some 7 > 0 with 
f(0) =0,0 < f’(0) < 1. Define a sequence f,,(x) by 


fiw) = f(x), fn(@) = (fo fr-i)(a), 2 = 1,2,.... 


Show that the series 37°, fn(x) converges uniformly on [—6, 6] for some 0 < 6 < 
n. 
Proof. Since f is twice continuously differentiable on (—7, 17), it follows that there 


is a positive constant M such that |f”’(x)| < M for |z| < n. Using the Taylor 
expansion of f at x = 0, we have 


f(a) = FO) + Ont 5 f@2?, 
where € is between 0 and x. Hence |é| < |a| < 7 and 
1 
Ce) < FOlel + sate? = (400) + 5Mlel) ll 
Let 6 = min{n, 2(1 — f’(0))/M}. For |z| < 6, we have 
1 
Lea] ¢ (40) + 5M8) fal = al 
where gq = f’(0) + M6 < f’(0)+$M-#(1- f’(0)) =1. Thus, we have 
Ifi(z) Sale|, |fe(z)| =|FCF(2))| < alf(@)| < @ lal. 
By induction, for every n € N, we have 
|fn(x)| < q”|a] < q"d. 


Since 0 < q < 1, it follows that )>>-_, ¢"6 converges. Therefore, by the Weiertrass 
M-test, >°°_, fn(x) converges uniformly on [—6, 6]. 


5. Two more proofs of Dini’s theorem. 
Proof. Without loss of generality, we assume that 
fn is continuous, decreasing, and f,, > 0 pointwise for all x € [a, }]. 


(Proof I) The first proof is based on the Heine-Borel theorem. For every € > 0, 
given x € [a,b], there is an N,(e) € N such that 


0< fn, (x) <e. 
Since fx, is continuous at x, there is a 6, such that 
O< fn, (t)<e, fort € (a@—dz,44 dz). (6.14) 


Thus, 
Uxela,b] (a —62,a2+ dx) 
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constitutes an open cover for [a,b]. By the Heine-Borel theorem, there is a finite 
number of open intervals 


{(xi — 6e,,0; + 6x,)}, t=1,2,...,m 
that cover [a,b]. Let 


N= max N,j,. 
l<i<m 


In view of (6.14) and the assumption that f, is decreasing, ifn > N, then we 
have 
0< frlx) <e 


for all x € [a,b]. This shows that f, > 0 uniformly. 


(Proof II) The second proof is based on the nested interval theorem. We proceed 
by contradiction. Assume that the convergence is not uniform on [a, b], then there 
is a €9 > 0 such that the following statement is true: 


For infinitely many n, f,(a) < € fails at some x € [a,b] which may depend on n. 


We split the interval into two equal halves and choose [a1,6;] as the half which 
is true: 


For infinitely many n, fn(x) < € fails at some x € [a1, bi] which may depend on n. 
Inductively, we can find a sequence of nested intervals [ax, bx] 
For infinitely many n, f,(x) < € fails at some x € [ax, b,] which may depend on n, 


where by — ax > 0 as k > co. By the nested interval theorem, there is a € € [a, D] 
contained in every [az, b,]. On the other hand, by the assumption that f, — 0, 
there is an N such that 


fn (§) < 0. 
By the continuity of fx, there is a 6 > 0 such that 


fn(y)<e forall |y—é| <6. 
Since b; — ay, > 0 as k > oo, there exists a K € N such that 
lax, bK] C (§ —46,€ +4). 
Moreover, for all y € [ax,bx«], by assumption that f,, is decreasing, we have 


frly) <fe(y)<e6 foralln>N,K. 


This contradicts the choice of [ax,bx«]. This completes the proof. 


Let the partial sum of °°, f/,(z) be uniformly bounded on [a,b]. Prove that if 
yr, f(x) converges pointwise on [a,b], then it converges uniformly on [a, )]. 


Proof. By the assumption, there is a positive constant M such that 

n 
AG 
k=1 


<M 
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for every n € N and for all x € [a,b]. Given € > 0, let P = {20,21,--- ,a} bea 


partition of [a,b] such that ||P|| < «/4M. By the Cauchy criterion for pointwise 
convergence, there exists an N € N such that 


< whenever n >m> WN andi=1,2,...,l. 


For any x € [a,b], without loss of generality, assume that x € [x;_1,a;]. If n > 
m > N, using the triangle inequality and the mean value theorem, we have 


d- fala) <] SO fal) 


d- (fe(2) - fle) 


k=m+1 k=m+ k=m+1 
<| S° fale) +] D> fa(G)||2—as| (where & € (#s-1,2%4)) 
k=m+1 k=m+1 
€ € € 
<=+2M|e—-—<2;|< ~-+2M-— =e. 
Sg t2Mle— als 5+ 4M 


By the Cauchy criterion, this proves that )°>~, f,(x) converges uniformly on 
(a, Ob]. 


In view of Abel’s continuity theorem (Theorem 6.18 with R = 1), if 79 an = 
8 < oo, then the power series 


F(a) = So ane” 
n=0 


converges for |a| < 1 and f(x) — s as x — 17~. Consider the power series 
yo (—-1)"a”. It has R = 1. Moreover, for |x| < 1, 


n=0 
Yara = ea =p 
1+2 
n=0 n=0 
We have 


: 2 a ; 1 1 


17 
e n=0 


But 5>>°_)(—1)” diverges. This indicates that the converse of Abel’s continuity 
theorem is not true. The following problem shows that the converse of Abel’s 
continuity theorem is valid under the additional hypothesis that na, — 0. 


7. (Tauber Theorem). Let f(x) = >7°. dnx” converge on (—1,1). If 


lim f(z)=S and lim na, =0, 
x>1- n+ oo 


then }7r° 5 Gn = 5. 


Proof. We use the typical “e/3 argument.” By the triangle inequality, we have 


nm n n foe) [oe) 
) a, —S ) ak — ) apa* ) apx® ) apx® — S|. 
k=0 k=0 k=0 k=0 


= k=n+1 


< + + (6.15) 
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Given any € > 0, we must find an N € N so that each term in the right hand side 
of (6.15) has an upper bound €/3 whenever n > N. To this end, in view of the 
assumption that limp... Nan = 0, the Stolz-Cesaro theorem implies that 


fim ett 2laal test rlan| 


n—-0o n 


0. (6.16) 
Next, choose x = x, = 1— +. The assumption lim,_,;- f(x) = S' yields 


Jim, (4 (1 - =| is s) =0. (6.17) 


Now for every € > 0, based on (6.16) and (6.17), there exists an N € N such that 


2 vit : 1 
laa] + Alaa] +o + mlan| < 7 nlan| < .. and |f(1——]-S|\< 7 
n 3 3 n 3 


whenever n > N. For 0 < x < 1, applying 
1-e* =(1—s)\(1l+ae+e7+---4+2"-") <k(1—2) 


and x = 1—1/n yields that 


n n n 
S- Qk -S- apz*| < (1-2) S- klax| 
k=0 k=0 k=0 
lay| + 2Ja2| +---+nla,| € 
= < 
n 3 


Similarly, for ¢ = 1-—1/n, 


co 1 co 
y apz®| < — ) klax|a* 
nm 
k=n+1 k=n+1 


IA 
YI o 
liggel: 
8 

q 
IA 
YI 0 
]8 
8 

> 


and 


= 1 

) apx* — § =\"0-2)-5]<$. 
n 3 

k=0 


Finally, putting all three estimates above into (6.15) yields 
ace 
k=0 


whenever n > N. This proves that 77° 4 an = S. 


<€, 


Remark. Inspired by the Tauber theorem, Hardy and Littlewood [53] extended 
the summation procedures which allow us to assign a series a generalized sum in 
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a natural way. For example, given a series 77°, dn, let f(x) = 775 ana”. If 
lim,_,1- f(a) exists, Hardy and Littlewood defined 


S- Gm = lim f(x) 
A=O x1 


and called the limit the Abel sum of the series. Using this approach yields the 
Abel sums of divergent series such as 


se (-1)" = ; and s (-1)"n= : 
n=0 n=0 


The Tauber theorem implies that the Abel sum is the same as the regular sum 
under the condition na, — 0. Littlewood strengthened the Tauber theorem by 
weakening the condition na, > 0 to the boundedness of na,. A similar technique 
for summation of a series is based on the averages of the partial sums. Let S,, = 


reo Gk and 


— Sot Sp t-+++Sn 
7 n+1 


n 


If on ~ 0 asn > ~&, we define 


lo) 
) An =O, 
n=0 


which is called the Cesaro sum of the series. By the Stolz-Cesaro theorem, o,, > s 
whenever S, — s. But 0, may still converge when S;,, does not. For example, 
the divergent series }>°° 9 (—1)" has the Cesaro sum 1/2, which is the same as 
its Abel sum. In the following, we show that Cesaro summation implies Able 
summation. 


8. Ifo, +o asn— oo, then f(r) = 97°. Gnx” converge on (—1, 1) and 


lim f(x) =o. 


x17 


This means that if a series is Ceséro summable then it is Able summable, and 
their sums are identical. 


Proof. Applying the Abel summation formula (2.14) twice yields 


[o.e) 
) An x” 
n=0 


ao + S°(Sp — Sp—1)a" = (1-2) S> Sp2” 
n=1 n=0 
= (1-2)? 5) (So9+ 51 +--+ + Sp)2” 
n=0 


= (1-2) S- (n+ 1)oyn2”. 


n=0 


Using the identity 
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we have a ae 
S- a,” —o = (1-2)? S- (n+1)(o, -—o)a”. 
n=0 n=0 


By the assumption 0, — o, for every € > 0, there is an N € N such that 
lon —o|<e foralln>N. 


Then for0< a <1, 


oo N lee) 
S¢ (n+ 1)(on — 0) x” < Si (n L)|on — ala” S- (n+ 1)|on — ola” 
n=0 n=0 n=N+1 
i € 
< (n+ l)|on — ola” : 
2 T=# 
When z is sufficiently close to 1, we can make 
N 
(1-2)? So (n+ Don —o| <e 
n=0 
and so 
ye (n+1)(on —o)a"| < 2e. 
n=0 
This shows that f(r) > 0 asa 17. 
Let « 4 nz for all n € Z. Show that 
1 1 1 1 1 
= = | | ; 6.18 
sin? x » (e+nm)? x? 2d (z +nn)?  (a- —) A618) 


Proof. First, observe that 


‘i cos?(t/2) + sin?(t/2) 1 if q 
(sam sin? [(a + aa) 


sin?t  4sin?(t/2)cos?(t/2) 4 


Repeatedly applying this identity yields 


1 = 1 ( 1 e 1 1 1 ) 
sin?a = 4? \ sin?(x/4) — sin?[(Q2n +.2)/4] sin? [(m+2)/4] sin? [(3a + x) /4] 


27-1 


1 1 
~ Q2n » sin?[(ka + x)/2"] 
For 2"-! <k < 2” —1, applying 


k—2” 
ane 2 ( ja+z 


Qn 


krn+a i ee 
= sin? ( ————_—_ 


oe af + n) = sin 


Worked Examples 313 


yields 
grata sala 
1 1 1 ; 
aa =a ———;, (619 
dina 2° se. sin?[(ka + 2) /2”] 2a, Cea aE ( ) 
where 2 
ree ae a | 1 1 | 
nm —~ 92n ea sin?[(ka fe x) /2"] (x +4 kr) /2")2 7 
Since 
i 1 cos* t 1 
0< =14 < 1, for t € [— 2% 9 ; 
sin?t  ¢? sintt  E2 or [—2/2, 2/2] 
it follows that 
1 ont 1 1 
0<Fa<ome Dy bog = ae for x € [0, 7/2}. 


Letting n > oo in (6.19) concludes (6.18) as desired. 


Clearly, the series (6.18) converges uniformly on any closed interval which does 
not contain the points of the form kz. In particular, we have 


i rs 1 1 = il 
5 = Lim ( 7 - 3) =? tap 


sin* x 


and so 


For x € (—7,7), by Corollary 6.3, in view of the fact that 


i 1 1\ (1. cost 
o. MeiCe ef ~ Rte sin’ 


Integrating (6.18) term by term yields 


“1 cosa 


= : ‘ 
0 x sln & 


x+ nt L— nT 


Pte 1 1 
cote = — S ( ) or x € (—7,7) (6.20) 


n=1 


Integrating (6.20) term by term, then taking exponentiation leads to the well- 
known Euler infinity product 


sin x -Tl (.- =): eg Creal (6.21) 


x 


In particular, setting « = 7/2 in (6.21) yields the Wallis’s formula again 


7 1 
?= II G-ga)- 
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Finally, using the trigonometric identities 
1 
tanx = cot(7/2—2), secx = —— =cot(x/2) —cotz, 
sin x 


by (6.20), we have 


= if 1 
t = 6.22 
oy 2 (se sige): 022) 
1: ce d 1 
csc g = —— = — + (—1)” ( ) 4 (6.23) 
sin xv x x+ nT xL— nT 


n=1 
10. Find the power series of tanx on (—1/2,7/2). 


Solution. For x € (—71/2,2/2), by (6.22), we have 


= 20 
eee os P= 
= a ado ESE (cans) 


n=1 m=0 


Interchanging the order of the summations, we find that 


a y a Soy )r/22 as) 


Since 


Co [oe) 


n=1 


it follows that 
it 1 g2k _ 1 


(Qn —1)2* 22k 


n=1 


Therefore, we have 


ee m m = C(2k) | on 
tanz = S- qeim+) 2(27¢ +1) _1)¢(2(m+1))x? +1 => S- o(27* 1) qk 2k I 
m=0 k=1 


The justification for interchanging the order without affecting the result is the 
following statement for the “double sum”: Let 8, = 37-9 |@nm|- If 37° Smv™ 
converges on (—R, R), then 


S- ie diane” = 3 (> own] xv”, for « € (—R,R). 


n=0 m=0 m=0 


11. (Monthly Problem 11848, 2015). Prove that 


Lin e-?*) = In(2m) 1 5a ss (—1)'™¢(2m) 
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Proof. Using the partial fraction 


reese 1 
m(2m+1) ~\2m %m-+1/)’ 


we have 
(-1)"C(2m) 4 (S (-)"C2m)_— A 1)" C(2m) 
m=1 “m(2m +1) os & 2m »y Oni tI . (6.24) 


In view of the partial fraction decomposition of cot x (6.20) 


2 


[oe) 
rx cotmx = 1+ S- 
n=1 


oe ae 
and 
lo) 
ae x? |n? pak 
x? — n? 1—2?/n? De ve 
k=1 
we have 


mx cot mx = 1—2 S- ¢(2k)a?* 


k=1 
Replacing x by 7a yields 
mx cothna = 1-2 So (- KC (2k) x? 
k=1 


Therefore, 


( ay"cCom dax 


m=1 


1 
= (4 = x cot) dx 
2\a 


(Ina — In(sinh rz))|9 


lI 
bo RNR SO 
nA 
—_ 


[In 20 — 7 — In(1 — e7?")). (6.25) 


(Sc rca dx 
=1 

1 

2 | 


Similarly, we have 


a=. a 


(1 —aacothra) dx 
Qe727e 
1 14 d 
f, (t-=*(1+ eae) & 
T oe 
ae nf Bye. eas 


1 T = 1 1 —2nt 1 —2n7r 
a (sas Anne nm © i 


-/ 
f 
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Using the fact that 


7 a” 
6(2) = —& and —In(1—- 2) => 


n=1 
we find that 


ee We 17) ee a 1 “a 
= aoa G 2 tafe 2"), 2 
Sail x gta ee re) (ee) 


m=1 
Plugging (6.25) and (6.26) into (6.24) results in 
= ae: i 
vee Se) oes Ss Sie 
m( om +1) 12 Qn 


m=1 


which is equivalent to the proposed result. 


Let ay be a nonnegative and decreasing sequence. Show that S>>°, an sinna 
converges uniformly on R if and only if limp. nay = 0. 


Proof. “=>” Assume the series )>>*_, a, sinnz converges uniformly on R. Then 
for every € > 0, there is an N € N such that 


n 
y dz sin kx 


k=m 


<e forall xz € R whenevern >m>WN. 


Let n > 2N,m = [n/24+ 1]. Then m > n/2 > N. Choosing x = 1/2n, we have 


S© ag sin(kr/2n)| < € (6.27) 
k=m 
When m < k < n, we have 
a oman. kr 
< < 
4 2n ~ 2n7 2 
Now (6.27) implies that 
es X a, sin(ka/2n) > sin ‘ >» ap > Me (n-—m+ lja, > a NO: 


This proves that limp... Nan = 0. 


“<—” Assume that limp». Nan = 0. Let 


Qn = sup {kag}. 
k>n 


Then a, is decreasing and converges to zero as n — oo. Let 


n 
x)= y ap sin ka. 
k=m 
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we want to show that 
ISmn(@)| <(7+3)am for every x ER. (6.28) 


Notice that S,,,(a) is an odd and periodic function with period 27. It suf- 
fices to show that (6.28) holds on [0,2]. To do so, we divide [0,7] into 
(0, «/n], [ar /n, r/ml, [x /m, 7], and show that (6.28) holds on each such subinterval. 


(1) If0 <a < a/n, then kx € [0,7] for all m<k <n. Using sin@ < 0 yields 


Sm (2)| = S- Gp sinkx <x Ne, kar 
k=m k=m 


n 
<2 S- a S A(n= M+ Lam < Tom. 


k=m 


(2) If t/n < a <7, in view of that sind > 2 6 for 6 € [0, 7/2], we have 


S ss eae he | cos(n 1/2) cos(m + 1/2)2| a 1 fe 2 
k=m 2sin(x/2) sin(x/2) — x 


By Abel’s lemma, we have 


m. 


[Sm n(@)| = M(Gm + 2an) < 3Mam < 3am. 


(3) Ifa/n <a <a/n, then m < r/ax <n. Let L = [7/az]. We have 


L n 
Smn(2) = S- ap sin ka + Ss ay sinkx = Smit (@) + St4in(2). 
k=m+1 k=L+1 


Since L < © < L +1, it follows that 2 < +. The result of (1) implies that 


|Sm,t(x)| < Tam. 
bot 5a SS and bl SS mm, by (2) and the decreasing of a,, we have 
|Sr4in(x)| < 3830r41 


and so 
[Sin,n()| < (3+ Tam. 


In summary, we have proved that (6.28) holds for every x € [0,7]. Therefore, the 
series converges uniformly on R. 


Remark. This result does not apply to )7°~_, Gn cos naz. Can you give a counterex- 
ample? 


Let a € R\ Z. Show that, for x € (—1,1), 


s (*) a” = (1+2)%, (6.29) 


(Generalized combination numbers) 


= (°) _ a(a=1)--(a=n+1) 


n! 
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Solution. Applying the ratio test for absolute convergence yields 


An+1 
an 


| eae 
~|n+1 


>lan7>o. 


This shows that the radius of convergence of the series is R = 1. Let the series 
be f(a). For every x € (—1,1), term by term differentiating gives 


(lt+2)fi(e) = 


= ()E lev 
o(ey 


This implies that 


[1+ 2)~* f(a) = -a(1 +2)" f(x) + (L+2)~° f(x) =0 


and so (1+ 2)~° f(a) =c on (—1,1). In view of 
f(x) =(1+a)*. 


Remark. If a > 0, since 


that f(0) = 1, we have 


1 
n( 1) =" te) slta>l ano, 
|an+1| em 
by the Raabe test, the series converges at x = +1. Moreover, by Theorem 6.17, 


the series converges uniformly on [—1, 1]. 
If —1 <a <0, when x = —1, we have 


Carre, — el lel+2. la 


+n-1 = |a| 


n 1 


and so the series diverges at x = —1. But, at 
alternating series. Since 0 < |a| < 1, we have 


n—-1 n 


x = 1, the series becomes an 


a-n 
= |an+1| 


IV 


fae a a 


n! 


sen Weefonntn), 


n+l 


and ap, — 0 as n > oo. The alternating series test concludes the series converges 
at « = 1. By Theorem 6.17 again, the series converges to (1+ x)® uniformly on 
(0, 1]. In particular, let a = —1/2 and replace x by —2? in (6.29). We find that 


1 M.S ON cg, 
Fae eG) : 


Integrating term by term (6.30) yields 


Co 


: 1 2n 
arcsin ® = » Qn +2" @E 


n=0 


2 € (-1,1). (6.30) 


ant) x €[-1,]]. (6.31) 
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14. (Monthly Problem 11897, 2016). Show for n > 0 that 
2k\ (2142 
Ce) Gan) =9 2n + 2 
k+1 n ; 


k+l=n,k>0,1>0 


Proof. We provide two proofs. The first proof is based on the ecneraling | functions. 
Let the left-hand side of the proposed identity be A. Using G)= 4 ha al yields 


() ena k+1) =) (oe) 


. Sa ae ~ C, n—k 
ae dare peas ac a 


Replacing x? by 4z in (6.30) gives 


se 2n\_,, 1 
Lo >= 
me V1l—4a 


Integrating both sides gives 


3 1 (7) on = Ee 


=a n+1 


Similarly, we have 


n 


ae Gea) n 1-v1—4¢ 
0 rn 
n=0 


Thus, the Cauchy product gives 


3 Go aes ae, iam 1-vl-4er 1 1 —4¢ 
= k+1 ry Qa or/1 — 4 


. Uae 1 1 
mae ( Qn? ' 92/1 — de =z) 
_ 1/2(n+ 2) 2(n + 1) 
- Bae n+1 
_ (2n+3 2n+2 
“Nal n+1/)° 
a + *) (“" + ’) @ + *) 
— + . 
n+1 n+1 n 
‘east 2n+3 *. 2n +2 9 2n +2 
n+1 n+1 n 
The second proof uses the Wilf-Zeilberger algorithm. Let 


se a mi (7) Ce 


Since 


it proves that 


as desired. 
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which is hypergeometric in both n and k. Using the Wilf-Zeilberger algorithm— 
EKHAD (available at https: //sites.math.rutgers.edu/~zeilberg/tokhniot/ 
EKHAD), we find that 


(—2n + 2k — 3)(h-+ 1) (2%) 2OTEED) ke 


es (n+2)(k +1)! 


and 
F(n,k) = G(n,k + 1) — G(n,k). 


Adding both sides over k for 0 << k <n, via telescoping, we end up with 


— 


n 


A=G(n,n+ 1) — G(n,0) =2( 


Remark. The Wilf-Zeilberger algorithm enables us to evaluate sums of binomial 
coefficients in a mechanical procedure. We refer the interested reader to [71] or 
[75] for details. 


Let fn(x) : [a,b] + R be continuous and f,(#) > 0 for all x € [a,b]. If 
ye fn() = f(x), show that f(x) attains its minimal on [a, 0]. 


Proof. Let m = infzeja,») f(a). Then there exists a sequence x, € [a,b] such that 
limn+oo f(an) = m. By the Borel-Weierstrass theorem, there is a subsequence 
Ln, —> Lo € [a,b] as k > oo. Thus, for every 6 > 0, we have 


= j f = i f 
a nee f(a) ea eee 


(x). (6.32) 


Now we show that f(a) = m. Since clearly m < f(a), it suffices to show that 
m > f(xo). To this end, in view of the series convergence at xo, for every € > 0, 
there exists an N € N such that 


N 
f (zo) - > Sn(%o) < 


Dol a 


By the continuity of f,, there is a 6 > 0 such that 


N N 
2d fn(x) - d fn(20)| < 5 whenever |x — xro| < 6. 


N 


N 
ys fi®) a eS fn(£o) <e 


n=1 n=1 


N 
< f(xo) - > Fn(®0) + 


whenever |x — 2o| < 0. In view of the property that f, > 0, ifn > N, we have 


f(to) —e< >) fale) < DO fale) 
k=1 


whenever |x — xo| < 6. Letting n — co yields 


f(xo) —€ < f(x) — whenever |x — 2| < 6. 
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16. 


(6.32) now implies that 


= inf > = 
aa ee ae f(x) = f(zo) —€ 


Since ¢ is arbitrary, it follows that m > f(ao) and so m = f (ao). 


Is it possible that f(x) attains its maximum on [a,b]? We show by example 
that f(z) need not attain the maximum on [a,}]. In view of Dini’s Theorem 
(Problem 4), we need to find a series which converges to f piontwise but not 
uniformly. Otherwise, by Theorem 6.6, f will be continuous on [a, }]. To this end, 
let fr(z) =a" —a”"*1, 2 € [0,1]. Then 


n—->co 


A iat Rete gah fai ed, 
He Le er’) = lim (x#-2 ak nde 


Clearly, sup,¢jo,1) f(z) = 1, but there is no ¢ € [0,1] such that f(t) = 1. 


A similar result is valid for the sequences , we show that if f, is an increasing 
and continuous function sequence and f,,(2) + f(x) pointwise, then f(x) need 
not attain the maximum. Define f,, : [0,1] > [0,00) by 


x; if x € [0,1 —1/nl, 
{ Ly(x), if € [l1—1/n, 1, 


where L,,(x) is a linear function which passes through the points (1—1/n, 1—1/n) 
and (1,0). Then f(a) satisfies 

(a) For each n EN, fn(x) is continuous and maxze¢jo,1) fn(@) = 1—1/n. 

(b) For each x € [0,1], fn(x) < fngi(x) (n = 1,2,...). 

(c) limp-+oo fn converges to 


_ fj a, ifeAl, 
fe) ={ 0, ife=1. 
Therefore, sup,c¢jo,1) f(x) = 1, but, there is no ¢ € [0,1] such that f(t) = 1. 


However, if we replace increasing by decreasing, the conclusion holds. 


(Monthly Problem 11765, 2014). Let C,, be the nth Catalan number, given 
by Cn = —4, (2”). Show that 


= n+1 
(yee a =5+45n, 
(b) Dro Be = 224 8V3r. 


Proof. First, we establish the generating function for the reciprocal of the central 
binomial coefficients 


> Ee 4(./4—2+./zsin '(,/z/2)) 
ao Gay 


n 


(6.33) 


n=0 


To this end, note that 
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we find that 
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ero gers +e 
n=0 
_ 2x an = 1l+a 


cag? t=e- Uae 


co 1 
G= 5° (n+ yf at” (1—t)” dt 
n=0 


-f'( 
=f 


2 (2n + 1)[xt(1 — ar) dt 


n=0 
1+at(1—-t) 
ia pe 


Now (6.33) follows from the direct calculation of the above integral. 


Next, applying at to both sides of (6.33) yields 


Y a2 a 


(84+ 2)/4—a + 12,/z sin™ 


(Ve /2)) 


aa air (6.34) 


By the ratio test, the radius of convergence of the series in (6.34) equals 4. Thus, 
letting « = 2 and 3 in (6.34) respectively, yields 


as claimed. 


Qn 3 
> Ge rae 
SS B= 9008/3 a, 


17. (Monthly Problem 12297, 2022). Prove 


i (cm 
0 


Proof. Recall that 


aa) dx = 5 (—m2). 


sin(x) 


n=1 


Since sinh7!a = + sin”! (ix) with i = /—1, we find 


(sinh + x) 


ae cay 1 gen 


Peer 


Worked Examples 


18. 


Hence, 
T/2 os hol (si 7 m/2( & —]1)r-192n-1 g; 2(n—1) 
| (= . ea) re = > (-1) an © \ ie 
0 sin(2) 0 n=1 n? ( n ) 
co am n—192n— n/2 
= S- ( on i sin2("—) x dx 
n=1 nw) 0 


II 
Me 
sie 
— 
Sy 
3 
| 
th 
iw) 
iw) 
3 
| 
— 
bo 
3 > 
Ly 
ees 
YS 


Fay oy oe) 
=F(2 *—-In2) = a (5 -m2) 


By Stirling’s formula, for large n, we have 
2n g?n 
n Jnr 


| ee gin2("-1) x 


mG) 


Thus, for large n, 


% 227-1 nt W/m 


n222n 93/2" 


Since )°°°_, 1/n°/? converges, the Weierstrass M-test justifies the term by term 
integration. 


Find 


33 ayn Hs 


9 
n=1m=1 n>m 
where H,, denotes the nth harmonic number. 


Solution. We show the sum is a _ 3In2 _ 5 In? 2. Denote the double series as 


H. The substitution k =n +m yields 


CO [oe) H 
a ol 


n=l1k=n+1 


Using 
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we have 
lore) lore) 1 
H = - S- S- (1)* / a*—) In(1 — x) dar 
n=l1k=n+1 0 


ll 
| 
oo 
aa 
Ss 
gan 
| 
8 
2 
Me 
a 
— 
_ 
8 
os 
ie 
So 
Q 
8 


Rewriting the integral as 


1 = 1 = 
qa | In(1 — a) oe +f In(1 — z) a 
9 il+¢2 9 (142)? 


in the first integral, using the substitution t = (1 — )/(1+ <2), we have 
1 = 1 
| In(1 — 2) eee | 1 In 2t dt 
6. ae Gee ele 


1 1 1 
_ i In2 a+ f nt 4 | In(l +t) 
6. Lae o itt o ltt 
2 


Here we have used the fact that 


' Int ess seas 1 T 
—dt= y —t)"Intdt = 5 yyrtt = : 
| 1+¢ i 2, oe a (n+ 1)? 12 


n=0 


Similarly, applying the same substitution in the second integral yields 


1 - 1 
| In(1 PF ac= 5 f fy ae ee 
9 (l+2)? 25 1+t 2 


Combining these two integral results, we find that 


2 4 1 
Ts se inde 
Dm 2 2 


as claimed. 


Remark. In general, for || < 1, we have 


So Peete BES) 5 ra a) aris): 


19. Evaluate 
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20. 


Solution. The value of the series is 77/32. Recall that 


(4 We, SMe ooh 

ee ee 
2k—1 3.5 4 

k=1 

Thus, 
1 nm ( 1)*-? a oO. ( 1)* 1 
4 2-1 2k—-1 
k=1 k=n+1 


F(a) =o an(z) S> ax(a), 
n=1 k=n+1 


where a(x) = (—1)""+ _ . By symmetry, we get 


ae), On (a >> an (x )-So a ay, (x) = arctan? x — S> az (x). 
n=1 k=1 n=1 n=1 
Since 
[oe) [oe) 1 qT 
Set -5 
nm = 2 bd 
ice! es (2n — 1) 8 
we find that 


This confirms that the value of the series is — f(1) = 77/32, as claimed. 


Remark. The mechanism behind the above technique is based on es s summa- 


tion formula. If both infinite series S := }7*%_, an and T := >~~_, a? converge, 


let An = op Ak On = peng Ge Then, by Abel’s summation formula, 


ue 1 1 
Sai > anb, = 5 (40 + SA, s vt) 5 8 —T). 


Let ¢ be the Riemann zeta function. Prove that 


3 (<a >> z) = 3¢(2) — (2(2). 
k=1 


n=1 


Proof. We give a proof based on Abel’s summation formula. Let An = > ;_1 a. 
Recall that 


n 


Se apbe = Anbn4i + S- Ax (be — bp41)- 


k=1 k=1 


The limit version of the above formula leads to 


S- Axby = lim Anbni + oe Ax (be — bg41)- 


k=1 k=1 
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co n Tl 2 n+l 1 2 
& ($2) -m(o-B3) 
k=1 


n=1 


n=1 hal 
leo) i n : - 

23 ap (@-Lm)-E at 
o 1 1 n 1 

= (5 aig) (*- 3 z) — ¢(3) + ¢(4) 


Since 


it follows that 


= 1 | 1 ing ws a” 
2 a d 
(co z) | ee i, 


n= k=1 n=1 
1 
=) Ing 14 7 du 
9 l-«z x 
= —¢(2) + 2¢(3). 


Similarly, we have 


Hence, 


where we have used ¢(4) = 14/90 = 2 (m?/6)? = 2 ¢?(2). 


Remark. Another way to evaluate this series is in terms of the multiple zeta 
function (see [18, Chapter 3], which is defined by 


co n-l 


Indeed, rewrite 


n=1 


. a ee 
¥ (c@-S ge) = ey ae 


Worked Examples 327 


Rearranging the sums by the cases: 7 = j,i < j and 2 > j, respectively, gives 


j=2 J 1=2 j=itl J j=2 J t=jt+1 
Bary 1 ~ ~ 2 1 ~ Ny: 1 
= a+ we aa + Oe 252 | ° 
1 J =1 >i U7 my ee 
j= i=1 j>i jal i>j 


In terms of the Riemann zeta function ¢ and the multiple zeta function ¢(a, b), 
we have 


> (co -S) = 6(3) — ¢(4) + (2,1) — 6(2,2) + ¢(2, 1) — ¢(2, 2) 


: = ¢(3) + 2¢(2,1) — ¢(4) — 2¢(2,2). 
Since 
¢(2,1) =C(3), ¢(a,b) + ¢(b,a) + C(a +8) = Cla)c(b), 
we obtain 
¥ (co Se) = (8) - 20) 


again. Along the same lines, in general, for p,q > 2, we can establish 


¥- (cw -¥-5) (<3) = cm 1)+¢(q, p—1)+¢(p+q—-1)—¢(p)¢(q). 


In particular, since 


(2,2) = 56(4), CB, 1) = 5 6(4), (8,2) = 36(2)618) - + C06), 
(3,3) = 5 (78) - 6(6), 6(4,2) = C08) - 56), 
we find that 
os («a - : =) («e = 5) = 2¢(4) ~ 6(2)¢(3), 
3 («o-¥ 5) (ce > 5) = -106(5) + 6¢(2)¢(3) — 2), 


n= 


We now end this section with one more example. It demonstrates a new approach 
to prove inequalities via power series. 


328 Sequences and Series of Functions 


21. (Nesbitt’s inequality). For all positive real numbers a,b, and c, show that 


a b _ oe 3 


t t >on. 
b+e eta a+b” 2 


Proof. This inequality, and along with several natural variations, has appeared in 
various mathematical competitions. Typically, it was proved by using either AM- 
GM inequality or Jensen’s inequality. Here we reprove it by using power series. 
By symmetry, we assume, without loss of generality, that a+b+ c= 1. So the 
original inequality becomes 


3 
! ! >2 for a,b 1). 
fa bond eC 


Note that the fractions in the left-hand side of the inequality above are the sums 
of some convergent geometric series. Thus, 


a b Cc a Sam +b% 4c" 
— n b” my) 
ae ae a +b" +c") oD. 5 
“ fatbte eo ty - 38 
2a =3 — == 
ee 


where the mean inequality is used. This proves the claimed inequality. 


6.7 Exercises 


The world of ideas is not revealed to us in one stroke; we must both permanently and 
unceasingly recreate it in our consciousness. — René Thom 


1. Let f(a) = an%e~™, (n = 1,2,....). Determine the value of a such that 
(a) fn(x) pointwise converges on [0, 1], 
(b) fn(x) uniformly converges on [0, 1], 
(c) limpsoo fy fn(x) de = fo litmnsoo f(a) de. 

2. Let k > 0 be an integer and define a sequence f,, : R - R by 


k 
n(L) = —>—., EN. 
f(@)= om, 1 
For which values of k does the sequence converge uniformly on R? On every 
bounded subset of R? 


3. Prove that )°°°, (—1)"*tx2"(1— x) converges absolutely as well as uniformly on 
(0, 1]. But the corresponding absolute series does not converge uniformly on (0, 1]. 


4. Let 43 


1 n 
oe Win(n+1)* : 
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10. 


11. 


12. 


13. 


14. 


Prove that 


(a) S(a) is continuous on [—1, 1]. 
(b) S%(—1) is finite but S’ (1) = oo. 


Determine whether or not that following series converges uniformly on (0, 00): 


OL aa OLFe™ OL tle-0+5)'] 


Let P,,(x) be a sequence of real polynomials with degree not to exceed N, a fixed 
integer. Assume that P,,(a) — 0 pointwisely for 0 < x < 1. Show that P,(x) > 0 
uniformly on [0, 1]. 

Let f, fn : R > R be functions such that fr(an) > f(a) as m > co whenever 
Ln — x. Prove that f(x) is continuous. 

Construct a sequence of continuous functions f, which is not uniformly conver- 
gent, but fn(x) > f(x) pointwisely and f(a) is continuous. 

Construct a sequence of continuous functions f, such that f,(7) > f(x) point- 
wisely but nowhere uniformly. 


Show that there exists a positive sequence a, < a2 <--- and a compact set C 
such that the sequence sin(a,x) converges pointwisely on C but not uniformly. 


Let f, : R— R be differentiable for each n € N with |f’(x)| < 1 for all n and z. 
Assume 


lim fn(a) = f(x) 


n—->oco 
for all z € R. Show that f(x) is continuous on R 


Let f : [0,1] — R be a continuous function. Define recurrently the sequence of 
functions on [0,1] by 


HG | "tae. aes i Pde BERS: 


Show that, for n € N, 


1 
(n—1 


n(x) = i i (a2 — +t)" f(t) de. 


Let fo(x) be integrable on [a,b]. Define the sequence 


fol) = fn—i(t)dt, (n =1,2,....). 


(a) Show that f,,(a) converges to 0 uniformly on [{a, 0]. 
(b) Show that f(z) = °°, fn(x) dz is continuous on [a,b] and find a simple 
expression for f(x). 


Let fn (rn € N) be continuously differentiable functions on [0,1) such that 


file) =1, fryi@) = fn(@) fri(@), fn4i(0) = 1. 


Show that limn+o. fn(a) exists for every x € [0,1) and find its limit. 
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15. Define the polynomial sequence by 
1 
P(x) =0, Pale) = Pail) +5 (w- P2 ae), nEN. 


Show that P,,(x) converges to \/x uniformly on R. 
16. Let pi (a) = 0 and 


a? — pn (2) 


Pati (2) = pplz) + 5} ; a ae 


Show that pp(a) > |x| on [—1, 1] uniformly. Notice that each p,(«) is a polyno- 
mial, this gives another explicit example of the Weierstrass approximation theo- 
rem. 

17. Let pp(x) be a sequence of polynomials. If p,(a) > p(x) on R uniformly, then 
p(x) is a polynomial. This result indicates that the Weierstrass approximation 
theorem holds only on finite closed intervals. 

18. Let B,(f) be the nth Bernstein polynomial of f. If f is Lipschitz continuous on 
(0, 1] with the Lipschitz constant L, show that 


1.20 
|Ba(f) — f(@)| < nis" 


19. Let B,(f) be the nth Bernstein polynomial of f. If |f”(a)| < M on [0,1], show 
that 


1 
|Bn(f) — f(a)| < a, Malt — 2). 
n 
20. Let B,(f) be the nth Bernstein polynomial of f. Show that 


lim n (B,(2°) — 2°) = 3(1 — 2)a”. 


n—->oco 


21. Let B,(f) be the nth Bernstein polynomial of f. Prove that 
(a) If f is increasing on [0,1], then so is B,(f). Hint: Let y, = f(k/n). Show 
that pn (2) 2*(1 — x)"~* is increasing on [0,1] for 0 <_m <n. Then use 
Abel’s summation formula. 
(b) If f is convex on [0,1], then so is B,(f). 


22. (Kelisky and Rivlin). Let f* be the kth iterate of the function f. For any 
function f(a) which is defined on [0, 1], show that 


lim (Bn(f))" = f(0) + (FQ) — F(0))2. 


k—-o0o 


This indicates that the only functions invariant under the map B,, are the linear 
function f(x) = ax + b. 


23. Let an,bp, be positive sequences. Suppose that the radius of convergence for 
rg Anz” is 1 and S7*° 9 an diverges. If limn—oo bn/dn = A, show that 
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24. Let f be continuous on R. Define 


Show that f,,(~) converges uniformly on every finite interval [a, }]. 


25. Let f(a): R > R be continuous and |f(x)| < || for each x 4 0. Define a sequence 
fn(£) b 
fila) = f(), fn(@) = (f° fr-1)("), n= 1,2,.... 


Show that the sequence f,(x) converges uniformly on [—A, A] for any positive 
constant A. 


26. Let fr : [0,1] > [0,00) be continuous for each n € N and 
fila) > fo(x) > f3(x) >--- for all x € [0,1]. 
If fr(a) > f(x) pointwisely, show that there exists t € [0,1] such that 


f(t)= sup f(a). 


x€[0,1] 


27. Let f(a) = 2a(1—x),a € R. Define a sequence f,,(x) by 
fila) = f(2), fn(@) = (f° fr-1)(t), n= 1,2,.... 


Evaluate is fr(a) dx 
28. Let f(a) : [0,1] > R be continuous. Define the sequence f,, : [0,1] — R by 


iO) = 7 (a) iala = - [ fn—i(t)dt, (n =1,2,....). 


Determine limn+o. fn(x) for every x € [0, 1]. 
29. Show that the infinite series 
ype caus (2+sinn)” 
ae 13m 
converges. 
30. Let 


ae s sin(2"2) 


n! 
n=0 


Show that this series diverges everywhere except x = 0. 


31. Let 
x, O0<a<1/2, 
oe)={ The 1/2<a<l. 


Then extend ¢(x) on R such that ¢(a + 1) = $(x). Define 
_ SS ot 
n=O 4" 


Show that f(a) is nowhere differentiable on R. 
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32. 


33. 


34. 


35. 


36. 


37. 


38. 
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(Peano Curve). Let 


0, 0<2<1/3, 
o(a)=¢ 384-1, 1/8 <a4< 2/3, 
1, 2/3<a<l. 


Then extend ¢(x) on R such that ¢(a + 2) = $(x), (—2) = ¢(x). Define 


32"t 
a) = Ae 
n=0 
co 32n+1 
y(t) = a 
n=0 


Prove that x(t) and y(t) are nowhere differentiable and determine the range of 
(x(t), y(t)) = [0, 1] x [0,1] for t € [0, 1). 


Let 
Pe) 


Ina) = x? + (1—nax)?’ aS (Ord), 


Show that the sequence f,, has no uniformly convergent subsequence. 


Let f be continuous on [1/2, 1]. Show that the sequence x” f(x) converges uni- 
formly on [1/2, 1] if and only if f(1) =0 


Determine if the series 
eee 
= 1+2 


converges uniformly on (—1, 1). 


Prove that for every odd continuous function f on [—1,1] and for every « > 0 


there is an n € N and cj, ¢2,...,¢n € R such that 
n 
2k+1 
max xr) — Chx <€. 
panax, |f(@) — De 


k=1 


Let f : [a,b] + R be continuously differentiable. Define 


ro 8l(3)-r(0-2) 


Show that F,,(a) converges uniformly on [a, 6] (a < a< 8 < b) and 


lim F,,(«)da = f(8) — f(a). 


n—->co a 


Prove that there is a unique series in the form of 
sin(72) -> Anx"(1— x)” 


that converges on R and |ja,| <M a for some constant M and for all n € N. 
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39. 


AO. 
Al. 


42. 


43. 


4A. 


45. 


46. 


A7. 


48. 


Let (aye 
—1)"- 
fn(a) = ae. cER, neN. 
Show that the series 377°, fn(x) converges uniformly on R and nowhere con- 
verges absolutely. 


Show that S>°° 
Show that 


Pg eq Cosnx does not converge uniformly on (0, 7]. 


Co n 


x 
2s l+a+a24+---p arom 
n=1 


converges uniformly on (0, 1]. 


Let {r1,172,°++ ,%,-++} be all rational number in (0,1). For each x € (0,1), define 
Ss Ee 
= sh 
xL>Tn 
Evaluate fof x) dx. 
Let {1r1,72,-++ ,7n,°++} be all rational number in [0,1]. For each x € (0, 1], define 


t) = 3 i a 
n=1 


Show that f(z) is continuous on [0,1] and differentiable at all irrationals in [0, 1]. 
Let the function f : (0,1) > [0,co) be zero except at the distinct points 
{ai, A2Q,--- ae Let Dn = f (an). 


(a) Prove that if >> , b, converges, then f is differentiable for least one point 
€ (0,1). 
(b) Prove that for any nonnegative sequence b,, with S°°~_, bp, diverges, there 
exists a sequence a, such that the function f defined as above is nowhere 
differentiable. 


Show that 


Let k € N and x > 0. Show that 


= 1 Fi : z 
ae Po itte® dt. 
d, (x + p)(2x +p)--- (nx +p)” ef ° 


n= 


Let & € N and |2| < 1. Show that 


ec In(1 — 2* 
a 1(4a- yt) =- = 


i=0 


(Monthly Problem 11597, 2011). Let f(x) = x/In(1 — x). Prove that for 
0<a2<l1, 


yd) PET" fe) = Farle). 


n=1 
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49. 


50. 


51. 


52. 


53. 


54. 
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Suppose the power series of f(a) converges in (—R, R). Show that, for |z| < R, 


SO) 1G Sa “)=[enme 


n=0 


Suppose the power series of f(x) converges in (—R,R). Let T,,(x) be its nth 
degree Taylor polynomial. 

(a) For |x| < R, find >>, (f(x) — Th(z)). 

(b) For |x| < R, find 2%, (-1)""“(f(w) — Tr(2)). 

Let Ky(#) be the Fejér kernel that is defined by 


1 sin[(n + 1)x/2]\? 
2(n + 1) ( sin(x/2) ) 


K, (2) = 


Prove that 
(a) forn € N and 0 < |a| <7, 


7 
< Kk < 
" n(z) S (n + 1)x? 
(b) forn EN, 
= K,(«) dx =1 
7 


(c) if f is continuous on [—7,7], then 


ie [Ky (w) f(a) de = (0) 


noo TT 


Let the sequence ¢,,(«) : [-1,1] > R satisfy 

(a) n(x) is nonnegative and continuous on [—1, 1]; 

(b) limn+oo ia on(x) dx = 1; 

(c) For any 0<c< 1, ¢n(x) uniformly converges to 0 on [—1,—c] and [e, 1]. 
If f(x) is continuous on [—1, 1], prove that 


1 


Show that Riemann zeta function ¢(7) = >>, + is continuous and differen- 


tiable on (1,00), but it does not converge uniformly on (1,00). 


Let fi, : [a,b] + R be a sequence of functions. f,(2) is uniformly integrable on 
(a, b] if for every € > 0, there exists a 6 > 0, which is independent of k, such that 


n(P, fr) >> WirAai <€, 


for all & € N and for all partitions P of [a, b] with ||P|| < 6. Show that if f,(«) is 
uniformly integrable on [a,b] and f, > f pointwise, then f is integrable on |a, D] 


and 
Jim af ful fr(x Jar= fo Jim fn(x) dx 
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59. 


56. 


57. 


58. 


59. 


60. 


(Monthly Problem 12207, 2020). Let f : [0,1] + R be a continuous function 
satisfying Joa x) dx = 1. Evaluate 


lim —— ye x” f(x") n(l — x) da. 
0 


noo Inn 


Let f and g be positive continuous functions on [a,b]. Let M = maxzeja,) f(x). 
Prove that 


(a) limpsoo fis g(a x)dx = M 


fe g(a) fr* (a) de 


VIz 9(a)$"(@) dex 
(c) limp-+oo 1 (9/0 at g(a) frtt(a x— Vf? of g(a) f(a ) ar) = MlinM. 


Let f : [0,1] > (0,1) and g : [0,1] — R be continuous functions 
with [> g(x) dx = 1. Prove that 


(b) limp—+oo 


(Monthly Problem 12242, 2021). For n > 1, let 


_ f heoat /2k-+ yy 
mo | Setajarenyaa 


Let L = limp. In. Compute L and limp... n(n — L). 


Let a, be a positive sequence, and let f,(2) = )>;_, anv*. Define 


_ file 
Hinsm) = f (Fasiayy 


If limy+o NA€n = A, show that, for any m € N, 


which is independent of m, and 


lim n(I(n,m) — L) = —A. 


n> co 


Let 0. Qn = A. Show that 
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61. 


62. 


63. 


64. 


65. 


66. 


67. 


68. 


69. 
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Evaluate 2 4 
. — 2£)x 
pec d, i= x 
Evaluate 7 ine 
ae se 


cos(nx). Show that 


* f(@) ™ > 1 
dx = : 
[ i+22°" 2 2 lan 


Let f(z) =. Ee 


Let a > 0 and let a, be a positive sequence such that 
1 n 
ae ee 


For every continuous function f on [0,1], show that 


1 
Jim, no 2 le )a=ar | ro" f(x) da. 


Let f(x) = 7p eT 


x = 0 only. 
Show that, for x € [—1, 1], 


" cosn?a. Show that the Taylor series of f(a) converges at 


: 1S 1 n 
(arcsinz)? = 5 De 2) (22)?", 
n=1 n 
foe) n—1 
3 i) 41 : 
(arcsina)* = 5 a {5 zh 2) (Qa)? 
n=1 k=1 n 
Let C,, be the Catalan numbers. Prove that 
3 1 : 4 x(4—2)3/? 46a ayers @ arcsin( aiey- gE (0, 4); 
nt = x|(4—2x)3/2+6 ax|(4—x2)+24 a| In a|+/4—2) /2 
cars C;,, 1 |2|(4—a) Vlal( aa ~~ | OE l4+v uel, (—4, 0]. 


Let C,, be the Catalan numbers. Prove that 

(a) Dinko ware = 3 

(b) 6 ante Cn = oF 

(c) Doped aren (1 a 2 reer i) a a 
Let C’, be the Catalan numbers. Prove that 

(a) Cho atantyz Cn = F102. 
(b) nko aeaeenFeesa Cn = 


56(3). 
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70. (Monthly Problem 12051, 2018). Prove that 


SS (2n 1 wT 1 95 
ye, = + — In* 2. 
nJAr(Q2n+1)% 48 4 


n=0 
71. Show that 
1 +) 2) 2 3 oo 
(arcsin x) 0 3 9 1 
i Vag = a 2m Ds IPB 


72. Let k EN, and let (arctanz)* = 0°, a(n, k)a”. Prove that 


= n+1 1 ee 


where 6(a) is the incomplete beta function and 


B(n +1) =(-1)” (m2 (1 ; pres 4 ay). 


2 
/ eS” cos(sin x) cos nx dx. 
0 


73. Evaluate 


74. Evaluate the following infinite series in closed form. 


OS Pe aap ae 
oo 1 
(b) ae, n2+n+1° 


n 


() ai Cy G@nPaay’ 


75. For « € (-1,1], calculate 


76. Determine the sum of 


77. Show that 


78. Show that 
(In(27) + y — 2). 


79. Show that 


2 aeea {oF ere 
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80. Show that 
(=1)" +7 (n+2)(?% 77) 


(a) g “+ an 42n+3 m = d, 
(b) T1, (1+ GF) =¢, 
where ¢ = (1+ V/5)/2 is the golden ratio and F,, is the nth Fibonacci number. 


81. Let « € R. Define the sequence x, recursively by 4; = 1 and %4, = #" + n@y 


for n > 1. Prove that 
[oe Fal 
Ul (1 z ) ae, 


av 
ry n+1 


82. (Monthly Problem 11299, 2007). Show that 


cee Aa n? ee e3/2 
II e (= — :) On” 
Hint: oe the logarithm of the infinite product as the combinations of 


co 2n)— 2n) 
pene 1 s(2n)—2 and as 1 ee 
83. Show fase 


2n 


= (-1)" 1 3 1 
ees Ind 
do m+ ireer ss: go? age 


where ¢ = (1+ V5)/2 is the golden ratio. 
84. Let ®,(x) be the nth cyclotomic polynomial which is define by 


®,(x) = II (c—€*), neN 


1<k<n, gcd(k,n)=1 


where € = e?**/". For example, ®;(x) = 2—1, ©2(z) = x +1, ©3(x) = a? +a+1. 
Show that 


1, @) (e2*) 1 (7, 45 
as nt eo er € a) c(3)). 


n=1 


85. (Putnam Problem 2016-B6). Evaluate 


= (-1)t} 1 
> k 2 k27 41° 


k=1 


86. Let {x} = x — [2] be the fractional part of x. Prove that for n € N, 


87. Let {x} = x — [2] be the fractional part of x. Prove that 
a) fy {2} {ag} de = 27-1. 
2 
b) ih fay {4} dx = 4ln(27) — 4y — 5. 
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88. Let {x} = x — [2] be the fractional part of x. For n € N, prove that 


89. 


90. 


91. 


92. 


93. 


94. 


95. 


96. 


1 


[ form (yew (n+ nt 


Test your result by 
(a) fo So (@+u) {Ay} dedy =1- $¢(3). 


(bo) 2 w+ uy? Lay} dedy = 1 1 6(3) — 2 6(4), 


Let |a| < 1. Evaluate 


[ In(1 + acos x) Pe 
0 


COS x 
Evaluate 
i In(1 — 2x cos @ + x”) 
dx. 
0 av 
Let 


Show that f(a) satisfies that 


f(x) + f/x) + n(1 — x) -In(1 - 1/z) = * 


Let a, be a numerical sequence. Show that series 


co x 

a 
S = f te dt 
n=1 


n+1 


S> k¢(k + 1). 


k=2 


= ¢(2). 


uniformly converges on (0,00) if and only if 377°, an converges. 


Evaluate 
ee) (n+1/2)ax 4 
lim aS nf et /? dt. 
20 A=1 (n—-1/2)x 
Show that 
we) 
mabe = nite 7 ~ 
Show that 
oS Inn 1.4 
—1)" — =y7 In2- = In*2. 
2 *—- =7n2—5 In 
Show that 
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97. Let H, be the nth harmonic number. Define 


H(k) = Cy Hr (k =0,1,2,...). 


98. (Monthly Problem 11916, 2016). Show that ifn,r, and s are positive integers, 


then 
n+r 3 r+k\{n+k\ _(nt+s . s+tk\ (nt+k 
n r—1 n 7 n s—1 n ) 
k=0 k=0 
Hint: Use the Wilf-Zeilberger algorithm. 
99. (Monthly Problem 12060, 2018). Show that 


100. (Monthly Problem 12026, 2018). For n €N, let 


ee oe ca na Se 


k=1 j=l 


eek 


Find limp+oo Sn/Inn and limp+oo (San — Son-1)- 
101. Define hn = 0p, a44- Prove that 


102. Let 


Prove that 
(a) For |a| <1, 


t 


co _4)n-1 1 2 

3 (-1)"" thn pa) (arctan(«t)) a 
0 

(b) For |x| <1, 


4 n 0 1 + t? 
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103. Let S, = )cp—9 1/(j). For |x| < 1, show that 


ree HO eel 2In(1— 2) 
Se Sean = B=) 
ay er 2-2 


104. Let k > 2 be positive integer. Evaluate 
() ay) = = x (G(R) - ha #)- 
: 7 ive Ss Cray (¢(k) wiet i) 
(Monthly Problem 3815, 1937). Let 


105. 


Show that there is a positive constant c,, independent of x, such that 


|f(z)|<c,mM(Inz), «r>e. 
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Show also that there is a sequence 71 < %2 <--- ~ o and a positive constant 


C2, independent of x, such that 


|f(v~)| >cgln(Inz), k=1,2,.... 


106. (Monthly Problem 11410, 2009). For 0 < ¢ < 7/2, find 


xr—0 


(ne)? 


107. (Monthly Problem 11515, 2010). Find a closed form expression for 


S > 4" sin4(2-"2). 
n=1 


1 sas —1)"-! gj 2 
lim a? [Jmenoe ( ) sy ine) 


s(n] : 


108. (Monthly Problem 11659, 2012). Let x be real with 0 < x < 1, and consider 


the sequence a, given by a9 = 0,a; = 1, and for n > 1, 


Show that 


Co 


k=—0o 


109. (Monthly Problem 11885, 2016). Prove that 


where ¢ is the Riemann zeta function. 
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110. 


111. 


112. 


113. 


114. 


115. 


116. 


117. 


118. 
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(Monthly Problem 11973, 2017). Let G be the Catalan constant. Prove 


oP ; > mye (1 z) 


n=0 


with ¢(0) = -1/2. 
(Monthly Problem 11982, 2017). Calculate 


am, (> (2)"] . 


n=1 


(Monthly Problem 11890, 2016). Find all x in (1,00) such that 


(24 2st) 43 1 +(e) de =f" dt 

xg «+1 3 \ 23 r+1 2g fee 
(Putnam Problem 2014-A1). Prove the every nonzero coefficient of the Taylor 
series of 


(l—2+27)e* 
about « = 0 is a rational number whose numerator (in lowest terms) is either 1 
or a prime number. 


(Putnam Problem 2015-B6). For & € N, let A(k) be the number of odd 
divisors of & in the inteval [1, 2k). Evaluate 


k=1 
Find 
A CD (;) 
k=0 
Evaluate me 
So:= S- neoth ' n(4n? — 3). 
n=2 
Hint: Using coth7! « = sin a and 
De eed 
2S9 _ 
i -Tl (#5) (24) 
Show that 


n= (2)" vam Tea aye*/e} 


For xz > 0, show that 


Co 


ye ee yee ee 
“=~ cosh(2n+1)a 4 sinh(2n + ja” 
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119. Evaluate the double sum 


120. Let n,m € N and (n,m) = 1. Find the closed form of 
S(n,m) = s = — 
La Lj? — mi 
t=1 j=1,njAmi 


and show that $(n,m) + $(m,n) = 1?/4nm. 
121. Show that 


where 


122. Show that 


123. (An Elementary Approximation for the Stirling Formula). Let n <€ N. 
For n > 2, show that 


1 
 < In(nt) (n+5) inn tn<l. 


124. For 0 <2 < 1, show that 


125. For positive x,y,z € R, show that 


2 2 2 
x 7] z 
ytz + atz + =), 


(>) (84) + (se) + (SR) s vo. 


(c) Let & > 0 be an integer and let a > 0 be a real number. For 2, y, z € (—1, 1), 
prove that 


(a) wty+z<2( 


2k yr* 2k ghyk yz gk ok 


ae * Ay" * 22 = a ay)® * Tyas * aay 
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Improper and Parametric Integration 


Nature laughs at the difficulties of integration. 
— Pierre-Simon de Laplace 


I could never resist an integral. 
— Godfrey Harold Hardy 


The Riemann integration in Chapter 5 has been defined only for functions that are 
bounded on a finite closed interval. In this chapter, with an extra limiting process, we 
develop rules which enable us to integrate some functions that are unbounded or are defined 
on an unbounded interval. When the integrand involves a parameter, a study of uniform 
convergence of the integral is needed in order to determine whether or not the differentiation 
and integration on the parameter are allowable under the integral sign. We establish the 
required theorems in Section 7.2. As an application, we introduce the basic theory of the 
gamma function and its relation to the beta function. The gamma function is often the first 
of the so-called special functions that the reader meets beyond the level of calculus, and 
frequently appears in formulas of analysis. Lots of analysis techniques have been invoked in 
the process of establishing various properties of the gamma function. 


7.1 Improper Integrals 


Mathematics is not the rigid and rigidity-producing schema that the layman thinks it is; 
rather, in it we find ourselves at that meeting point of constraint and freedom that is the 
very essence of human nature. — Hermann Weyl 


First, we extend the definition of the Riemann integral ie f(a) dx to integrands which 
are unbounded at x = b. Let’s begin with [a,b] = [0,1]. Let f(z) = (1—2)~! and g(x) = 
1/V1— 2, respectively. For each 0 < c < 1, we have 


| f(x) dx = —lIn(1— 0), / g(a) dx = 2(1— V1 —c). 

0 0 

As c + 1, the value of the first integral tends to oo, but the second integral has the finite 
limit 2. With these examples in mind we define an improper integral as follows. 


Definition 7.1. Let f be Riemann integrable on [a,c] for each c < b. We define 


[ A\te— Tk [ notre 


cb 


If this limit exists then the improper integral converges, otherwise it diverges. 


Recall that if p £ 1, for any a < c < b, we have 


[ owe- + (ea)? — (6-0). 
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Based on Definition 7.1, we find that 
Example 7.1. The improper integral ae (b— x)? dx converges if and only if0<p< 1. 


In analogy with convergence of infinite sequences and series, it is important to establish 
criteria that tests when improper integrals converge. The following result offers a basic tool 
in determining the convergence. 


Theorem 7.1 (Comparison Test). Let f be continuous on [a,b) and |f(a)| < g(a) for 
all « € [a,b). If i. g(x) dx converges, then fe f(x) dx converges and 


i " F(a) de| < | wore 


As a corollary, we have the following comparison test for divergence. 
Corollary 7.1 Let f and g be continuous on [a,b) and 0 < g(x) < f(x) for all x € [a,b). 
If ii g(x) dx diverges, then ake f(x) dx diverges. 

We now turn to the convergence of integrals in which the integrand is bounded but 
where the interval of integration is unbounded. 


Definition 7.2. Let f be Riemann integrable on [a, R] for each R> a. Then 


i” F(x) de = jim [ f(x) de. 


If this limit exists then the improper integral converges, otherwise it diverges. 
In contrast to Example 7.1, we have 
Example 7.2. The improper integral 1 Si x? dx (a> 0) converges if and only if p > 1. 


As with convergence of sequences and series, there is a Cauchy criterion for improper 
integrals. 


Theorem 7.2 (Cauchy Criterion). fe f(x) dx converges if and only if for every « > 0 
there is an RE R such that 


[ ° f(a) dx 


The corresponding comparison test becomes 


<e whenever B>A>R. 


Theorem 7.3 (Comparison Test). Let f(x) and g(x) be continuous functions on [a, oo) 
with 0 < f(x) < g(x) for all x € [a, co). 


1. If ee. g(x) dx converges, then oe f(x) dx converges. 
2. If aie f(x) dx diverges, then tia g(x) dx diverges. 


The convergence of integrals with unbounded integrands while the interval is infinite 
may be treated by combining Theorems 7.1 and 7.2. The following example illustrates the 
method. 


Example 7.3. Test convergence for 
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In view of the improper nature of the integral, we decompose it into two parts: 
1 —2x@ Co —2x2 
e€ e€ 
—dzx and / — dz. 
I Va 1 ve 


e */Ja<1/Va for x € [0,1] 


Since 


and 
e *//x<e* for x € (1,00), 


the comparison test yields that both integrals above converge. Therefore, the original inte- 
gral converges. 

The integral test for infinite series (Theorem 2.22) suggests that much of the theory of 
convergence for improper integrals is similar to that of infinite series. To be specific, we 
have 


Theorem 7.4. The improper site f(x) dx converges if and only if for every sequence a = 
ag <a, <a <--- with a, > © as n— ov, the series 


Send Qn41 

yf fea 

n=0 % Gn 
converges and 


7 Flajae= Sof flayde: 


Proof. “= >” Suppose that af f(x) dx converges. By the Cauchy criterion, for every « > 0 
there is an R € R such that 


i ” ta) de 


Since a, — co as n — oo, there exists some N € N such that a, > an > R whenever 


m>n>  N. Hence 
An+1 An+2 am am 
i rote +f fie aes f 5 yas | faye 
a Qn+1 1 an 
This implies that the series 77°, [°"** f(a) da converges by the Cauchy criterion for the 
series. 
“<==” We proceed by contradiction. Suppose that the series S77, [ 


an 


<e whenever B>A>R. 


<eé. 


n am— 


“m+ #(x) dx con- 


verges for every sequence ay, but Je f(x) dx diverges. Thus, there is an € > 0 such that 


for any R>a 
[ ia 
A 


In particular, let ag = a, Rp = max{1,a}. There is a, > Rg such that 


>e whenever A> R. 


/ f(a) dx] >e whenever a; > Ro. 
ay 


Next, let Ry = max{2,a,}. Then there is ag > R, such that 


/ f(a) dx| >e whenever az > Rj. 
a2 
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In general, let R, = max{n + 1,a,}. Then there is a,41 > Ry such that 


_ f(a) dx 


Clearly, a, is increasing and a, + oo as n — oo. Moreover, we have 


i " Fla) de 


This contradicts that the series >>, Hire f(a) dx converges for every sequence Gy. 


>e whenever a, > Ry_1. 


co 


S- [ f(a) dx 


kik ke 


> €. 


This following example demonstrates explicitly how to use the series convergence tests 
in determining the convergence of improper integrals. 


Example 7.4. Test convergence for 


=) sind 
0 x 


Let ayn = nz for n = 0,1,.... We first show the corresponding series 


3 ee eu dx 
= nt x 


converges. Indeed, let « = naz +t. Then 


co (n+1)m |: loo) T ee 
s- / sit = 3 (1 f sint 
ono Unm x =f 9 nr+t 


. Tv i . . 
Since Jo sint dt is a decreasing sequence and 


nat+t 
™ sint ved 1 
/ ite ar< [ —dt=-—>0 (asn—oo), 
0 0 


by the alternating series test, it follows that the series converges. 
Let 5 => 6 oan sin® dy. Then for every € > 0, there is an N € N such that 


n-1 pe ste suet 


nn s 
sin x 
if ae—s| = y 
0 x kr x 


k=0 


<e whenever n> N. (7.1) 


To prove that J converges, assume R > Nz. Then there is an no € N such that not < R< 
(no + 1)r. Since sin x does not change sign on (no7, (no + 1)z), it follows that the integral 


ee sin# da is between [)°" “2# dx and ieee sin# dx. In view of (7.1), it implies that 


both fj°" 984 dx and (nn sin2 dz are between S —e and $ +. Therefore, 


R.. 
sin at 
| dz — S| <e whenever R > Na 
0 av 


and so 
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Consequently, as an application of the expansion of csc (6.23), we find that 


fle sg So POtDn sin ¢ 
S= d. d. 
a. wed Sf ae 


n=0 227 n—0 m+n /2 
= “2 sint = n/2 sint 

= —1)” dt 1)” dt 
I, oo nr +t + a (n+1)a—-t 


7/2 sing 1 1 
— — dt t int dt 
i. an (ge —) sin 
r+ oe sint dt 
t+nr 't—nt 


m/2 
| esctsint dt = = 
0 


Here the term by term integration is justified by showing that 


( Wn 1 1 ina 
) ++ sin 
ees t+ nr t-—ntT ‘ 


uniformly converges on [0,7/2]. This follows from the Weierstrass M-test with M, = 
1 
m(n2—1/4)°* 
It is interesting to notice that I does not converge absolutely, i-e., the integral 
ie —— dx diverges. Indeed, we may obtain as before that 


‘4 Sma dy yee |sing| =f sint 
0 pee 


Since na +t < (n+ 1)a for t € [0,7], it follows that 


7 sint 1 Ohne 2 
dt > ——_—_— sint dt = ———— 
0 nrt+t (n+1)r Jo (n+ 1)7 


But the series 2 °°, =i; diverges, this implies that (ee {sine dx diverges. 

When the improper integral does not necessarily absolutely converge, the comparison 
test is not applicable. Combining the Cauchy criterion and the second mean value theorem 
for integrals, we establish two more robust tests which improve the existing Dirichlet’s and 


Abel’s tests. We begin with an example. 


Example 7.5. Let f be Riemann integrable on [a, R| (a > 1) for any R> a. Prove that if 
J-° xf (x) dx converges, so does Aa f(x) dx itself. 


Proof. For every B > A>a> 1, we have 


-|f xf (x) 


x) dx 
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In view of the fact that 1/az is decreasing and nonnegative, x f(x) is integrable on [A, B], 
applying the second mean value theorem for integral yields 


[ f(a) de oan af (x) dx 


for some € € (A,B). By the assumption, if we take A and B sufficiently large, for every 


given € > 0, we will have 
B 
[ fou 
A 


This proves that ie f(x) dx converges by the Cauchy criterion. 


<e€. 


Using the ingredients contained in the proof of this example, we first establish Dirichlet’s 
Test. Unlike the existing literature, we show that Dirichlet’s test is not only necessary but 
also sufficient. 


Theorem 7.5 (Dirichlet’s Test). Let f : [a,oo) + R be Riemann integrable on |[a, R] for 
every R > a. The improper integral ee f(x) dx converges if and only if f(x) = u(x)v(x) 
such that 

1. u(x) is monotone and limz-+. u(x) = 0, 


2. For every R> a, 1 


, V(x) dx exists and bounded. 


Proof. “= >” Suppose that fit f(x) dx converges. By the Cauchy criterion, there is A; > a 


such that 
B 
[sea 
A 


By induction, for n > 2, there is A, > An—1; + 1 such that 


i i f(a) dx 


Clearly, the sequence A, > oo monotonically. For each n € N, let 


<1 whenever B> A> A. 


1 
Sig whenever B> A> Ay. 
n 


-f 1, @é€[a,Aj 
u(x) = { i x € (An, An+1| 
and 
u(x) = a PE [a0 


Thus, f(z) = u(x)v(a) and u(x) satisfies (1) as expected. We now show that u(x) satisfies 
(2). Since both f(x) and 1/u(x) are integrable on [a, R] for any R > a, it follows that 


ee v(x) dx exists, and so it suffices to show that os v(x) dx is bounded. If a < R < Aj, 
here v(x) = f(x). By assumption, there is a positive constant M such that 


is v(a) dx 


<M. 
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If R > Aj, there ism €N such that A, < R < Am+1. Moreover, 


if ol i css | te eae : lide 


I 


a n=1 7 An Am 

At m1 An+1 R 
< f(a) dx) + i nf (x) dx] +m f(x) dx 

pa a, es 

1 1 1 
< M414+2-5 
< Tee ipg eet (m—1) EEN m3 
m 1 . 


“<=” Let V(R) = ie v(x) dz. By assumption, there is a positive constant AK such that 


|\V(R)| < K for every R > a. Applying the second mean value theorem for integrals yields 


B é B 
i: u(a)u(a) dx = u(A) i u(x) dx + u(B) i: u(x) dz whenever B> A> a, 


where € € (A, B). Also, 


On the other hand, for every « > 0, there is a X > 0 such that |u(a)| < 7 whenever 
x > X. Therefore, for B> A> X, 


|  ateaede 


A 


€ 
< |u(A)| | I v(a) de 


B 
+ Ju(B)| iv WB ae 


€ € 


This shows that f° f(x) dx converges by the Cauchy criterion. 


As a direct consequence of this enhanced Dirichlet’s test, the regular Abel’s test can be 
improved through the following theorem. 


Theorem 7.6 (Abel’s Test). Let f : [a,oo) —~ R be Riemann integrable on [a, R] for 
every R > a. The improper integral ee f(x) dx converges if and only if f(x) = u(x)v(x) 
such that 


1. u(x) is monotone and bounded, 


2. [-* v(x) dx converges. 


These two tests can be used to determine the convergence of series such as 


ca esinax | a sina SIN 20 °° sin(x + x?) d 
Ee Co ey —— de 
o bf +a 0 x 0 x 


where a,b,a > 0. 
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7.2 Integrals with Parameters 


“T had learned to do integrals by various methods shown in a book that my high school 
physics teacher Mr. Bader had given me. [It] showed how to differentiate parameters 
under the integral sign—it’s a certain operation. It turns out that’s not taught very much 
in the universities; they don’t emphasize it. But I caught on how to use that method, and 
I used that one damn tool again and again. [If] guys at MIT or Princeton had trouble 
doing a certain integral, [then] I come along and try differentiating under the integral 
sign, and often it worked. So I got a great reputation for doing integrals, only because 
my box of tools was different from everybody elses, and they had tried all their tools on 
it before giving the problem to me.” — Richard Feynman 


The solutions of practical problems, especially in differential equations, are frequently 


given in terms of integrals with parameters. For example, the arc length of the ellipse 
x? /a? + y?/b? = 1 is given by 


m/2 n/2 
L=4 | Ve sin? t+ cos? tat = 4b | V1—k2 sin? ¢ dt, 
0 0 


where k = Vb? — a?/b is the eccentricity. This leads to the elliptic integral 
m/2 
E(k) = if V1 —k? sin? t dt 
0 


with the parameter k. In general, 


Definition 7.3. Let D C R and f(a,t) : [a,b] x D > R. For every t € D, f(x,t) is 
Riemann integrable on [a,b]. Then 


b 
I(t) = / f(a,t) dx (7.2) 


is called an integral with parameter t. 


Observe that the integral of a sequence of functions 


i= ie f(x) de 


is a special case of (7.2) with D = N and the parameter n. 

For the functions define by (7.2), we are interested in when it is possible to interchange 
the calculus operations (limit, differentiation and integration) with the integral—commonly 
known as calculus operations under the integral sign. 

First, similar to Definition 6.2, we introduce 


Definition 7.4. f(x,t) : [a,b] x D—R converges to g(x) uniformly as t > to if 
1. lime4t, f(z, t) = g(x) for each x € [a,b]. 


2. For every € > 0 there exists a 6 > 0, which is independent on x, such that 


|f (x,t) — g(x)| <€ whenever |t — to| <6 and for all x € [a,b]. 
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Equipped with this definition, if D = [c,d] is bounded and f is Riemann integrable on 
[a,b] for every t € D, under very mild conditions, we are allowed to take all the calculus 
operations under the integral sign. To be specific, we have 


Theorem 7.7. Let f be integrable on [a,b] for every t € D. If f(a,t) converges to g(x) 
uniformly as t — to, then g(x) is integrable on [a,b] and 


b b 
Jim fs f(a,t Jax = [ lim f(z, t) ax = [ g(x) da. 
a toto my 


Theorem 7.8. If f(x,t) is continuous on [a,b] x [c,d], then 
b 
= / f(a, t) dx 


The hypotheses on the continuity of f on [a,b] x [c,d] is necessary. The function 


flat) ={ siz, (2,t) # (0,0) 


is continuous on [c,d]. 


0, (x, t) = (0,0) 


provides a counterexample on [0,1] x [0,1]. Indeed, we have 
x 1 7 
= / f(x, t) dx = arctan () +a asta Or 
0 


This implies [(¢) is not continuous at t = 0 since I(0 a ee x,0) dx =0. 
Theorem 7.9 (Fubini’s Theorem). /f f(x,t) is continuous on [a,b] x [c,d], then 


ce f(z,t) deat = ff f(a, t) dtde. 


Theorem 7.10 (Leibniz’s Rule). Jf f(x,t), fi(x,t) are continuous on [a,b] x [c,d], then 


-{ f(a, t) dx 
w= fila, t) dx 


Here we give a proof of Leibniz’s rule only. The proofs of Theorems 7.7—7.9 are pretty 
straight forward and are left to the reader. 


is differentiable on [c,d] and 


Proof of Leibniz’s Rule. Let 


= [Het ae, té [ed]. 


For any t € [c,d], since f;(x,t) is continuous on [a,b] x [c,d], by Fubini’s theorem, we have 


[9 ue [none 


Q 
H 
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Since g(t) is continuous on [c,d] by Theorem 7.8, using the Second fundamental theorem of 
calculus, we have 
d t b 
r=(f alsras) =o = f fletyae 


We illustrate some applications of these theorems with three examples. 


as desired. 


Example 7.6. For0<a< )b, find 


Solution. Observe that 


Ing 


Clearly, f(z,t) = x? is continuous on [0,1] x [a,b]. By Fubini’s theorem, we find that 
1 b b 1 b 

dt 1+6 

r=] [vat ac = | [ea a= fo =m ; 

0 a a (0) a 1 + t 1 ra 


Example 7.7. Evaluate 


x/ 
1) = f “in (742252) ae. “ee iieety: 


1—tcosxz/ cosx 


Solution. We present two solutions based on Fubini’s theorem and Leibniz’s rule, respec- 


tively. First, let 
1 1+tcosa 
t)= . 
f(2,t) cos x a (ee 


Since 


In(l +t In(1 — 
ia, $a) Sie ( n(l+tcosx)  In( 2 = 9, 
arn /2 an /2 COS X COS Z 


it follows that f(z,t) is continuous on [0, 7/2] x [-T,T] for any 0 < T < 1. In view of that 


f(z, t) = 


In(1 + tcos 2) inGh = toose) dy 
COS x COs z ~ J, 1+ ycosz’ 


by Fubini’s theorem, we have 


t m/2 1 
=] | + __ drdy 
s4 1+ ycoszx 
ke 
-[ e yeaa dxdy 
-t 1 — y? cos 
=2 dad 
[ [ or er: ae 


=f? =e 
0 2 ae 
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where we have used the fact that 


t 
yCosx 
I. 1 — y? cos? x 4 


because the integrand is odd in y. 


Next, notice that 
2 


1—t? cos? x 


Si(x,t) a 


is continuous on [0,7/2] x [-T, 7] for any 0 < T < 1. Applying Leibniz’s rule, we have 


’ m/2 9 
I(t) = —.——_ d 
(6) i 1—fcosta 


n/2 2 

sec” x 

— 2 | —3— a de (use u = tan x) 
0 sece x —t 


ds = rm arcsint. 


t 
T 
if v1—s? 


Example 7.8. Prove that, for everyt € R, 
20 
F(t) = | e' ©” cos(t sin x) dx = 2r. 
0 


Proof. Notice that F(0) = 27. We now show that F'(t) is a constant. To this end, applying 
Leibniz’s rule yields 


20 20 
i) = | e' 5" cos(t sin x) cos x dx -f e' ©” sin(t sin x) sin x dx 
0 0 
20 
= e' °S* cos(tsin x + x) dz. 
0 
By induction, for each n € N, we have 
2r 
FO (t) = | e' ©” cos(tsin x + nx) dx. 
0 
Hence, 
20 
Po) = f cosnxdx=0, n=1,2,.... 
0 


Applying Taylor’s theorem (Theorem 4.21) yields 


n 


FQ) =o Oak + Ra) = 29 + PME, 
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27 
a) elél de = 2nelél, 
0 


where € is between 0 and t. Since 


27 
PFO EO|=| fo ef * cos(Esina + ne) de 
0 


for each fixed t € R, it follows that 


This proves that F(t) = F(0) = 2r. 


We now take up the improper integrals with parameter in the form of 


= f(a,t) dx. (7.3) 


To ensure integrability we assume that f(a, ¢) is continuous on |a,0o) x I for some interval 
I. 

The following example shows the difference between (7.2) and (7.3). Specifically, we show 
that Theorem 7.7 does not hold for improper integral (7.3) even if f(x, t) converges to g(x) 
uniformly at to. 


Example 7.9. Let 


Since 


ee f(Jt/ 3, t) = et, 


x€[0, 


it follows that f(x,t) — 0 uniformly on [0,00) as t > oo. ae for any t > 0, 


co R 
if f(e,t)de= lim / f(x,t)dx = lim en t/ 2a” é = |. 
0 Roo Jo R-0o 


To eliminate this kind of drawback, just as we did for infinite series of functions, we 
introduce the uniform convergence for integrals, which determines the nature of convergence 
of the integral for all t € I. 


Definition 7.5. The integral ie f(a,t) dx converges uniformly on I if for every « > 0 
there is R >a, which is independent of t, such that 


I Seb aae 


This definition is seldom a practical method for deciding whether or not a specific integral 
converges uniformly. Analogous to the uniform convergence tests for the series of functions, 
we have the following uniform convergence tests for integrals. Their proofs are similar to 
the series version and are left to the reader. 

[a f(a,t)d 


Then Ni f (x,t) dx converges uniform on I if and only if 


<e whenever A> R and for allt € I. 


Theorem 7.11. Let 


= sup 
tel 


fim (A) = 0. 
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Example 7.10. Show that i ie te dx converges uniformly on [c,co) for any c > 0, but 
not uniform on (0,00). 


Proof. For any c > 0, we have 


w(A) = sup =e “°_,0 as Ao. 


tE[c,co) 


Co 
i te dx 
A 


By Theorem 7.11, the integral converges uniformly on [c,co). On the other hand, since 


[oe) 
/ te dx 
A 


by Theorem 7.11 again, the integral does not converge uniformly. 


= sup hen ted =1/,0, 


tE(0,co) 


w(A) = sup 
tE (0,00) 


Theorem 7.12 (Cauchy Criterion). ee f (x,t) dx converges uniformly on I if and only 
if for every € > 0 there exists a R >a, which is independent on t, such that 


I 7 f(a,t) dx 


Theorem 7.13 (Weierstrass M-Test). Let f be continuous on [a,oo) x I. If there exists 
a continuous function g(x) such that 


<e whenever B> A> R and for allt € I. 


1. |f(x,t)| < g(x) for all x € [a,oo) and for allt € I, 
2. [-* g(x) dx converges, 


then oi f (x,t) dx converges uniformly on I. 
Theorem 7.14 (Dirichlet’s Test). Assume that 
1. g(x,t) is monotone in x and g(x,t) > 0 uniformly on I, 
2. ie f(a, t) dx is bounded for every A> a and for allt € I, 
then bee f(x, t)g(a, t) dx converges uniformly on I. 
Theorem 7.15 (Abel’s Test). Assume that 


1. g(x,t) is monotone in x and bounded on [a,co) x I, 
2. te f (x,t) dx converges uniformly on I, 
then [> f(a, t)g(a,t) dx converges uniformly on I. 
Remark. As the consequence of either Dirichlet’s test or Abel’s test, if y f(a) dx con- 


verges, then integrals such as 


i * 6 *t F(x) dn, | ae ay eC 


converge uniformly on t € [0, 00). 


Example 7.11. Consider 


°° sin x? 
T(t)= dx. 
@-[ Fae 


Test whether or not the convergence is uniform on [0,00). 
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eet °° sinu 
sin x ax = | du 
i 0 2fu 


converges (for example, by Dirichlet’s test) and is independent of t, it follows that 
Jo. sina? dx converges uniformly on {0, 00). For every fixed t € [0, 00), 1/(1 + 2") is mono- 
tone on x and 


Since 


1 
a  L, 
1+a2t|— 


Thus, by Abel’s test, [(¢) converges uniformly on [0, 00). 
Here is an alternate proof using Dirichlet’s test: Rewrite I(t) as 


1 
<: 2 
I(t) -{ “e“sin & aia 


For any A > 0, we have 


A 
fi xsin a? dx <1. 
0 


1 

2|A 
= |—-—= COSZX 
[5 cos 


For every fixed t € [0, 00), ae) is monotone in x and 
1 1 
50 e))| a >0O asta. 


Thus, by Dirichlet’s test, I(t) converges uniformly on [0, 00). 

Similar to Theorem 7.4, we have the following uniform convergence test in terms of 
series. The proof is very similar to the proof of Theorem 7.4. We leave that proof to the 
reader. 


Theorem 7.16. The integral sg f(a,t) dx converges uniformly on I if and only if for 
every sequence d= dp < a, < a2 <-:-: with an > ~w asn— ~, the series 


D i a fla,t)de 


converges uniformly on I. 


The next three theorems illustrate the importance of uniform convergence. We leave the 
proofs to the reader. The first says that the uniformly convergent integral of a continuous 
function is continuous. 


Theorem 7.17. Let f(x,t) be continuous on [a, oo) x [c,d]. If f° f(x, t) dx + F(t) uni- 
formly on [c,d], then F(t) is continuous on [c,d] and for any to € [c, d], 


Co Co Co 
=> i = i = t d 
Fo) = jim fo fathde= [jim sle.tde =f fleta)ae 
Using this result on continuity, the next theorem allows us to interchange the order of a 
Riemann integral and an improper integral. 


Theorem 7.18. Let f(x,t) be continuous on [a, oo) x [c,d]. If f° f(x, t) dx + F(t) uni- 
formly on [c,d], then F(t) is integrable on [c,d] and 


[roa- ff fe,)aea = ff f(a,t) dtde. 


Integrals with Parameters 359 


The next theorem tells us when we can differentiate under the integral sign. 


Theorem 7.19. Let f(x,t) and f;,(x,t) be continuous on [a,co) x [e,d]. If f-~ f(a, t) dx 
converges to F(t) on [c,d] and fae fi(a,t) dx converges uniformly on [c,d] , then F(t) is 
differentiable and for each t € (c,d) 


PG). £ / f(a, t) dx = / fila, t) dtda. 


Example 7.12. Fora 40, show that 


Pook 
F(t)= i; —(1—e7*) cosaz dx 
0 x 
is continuous on (0,00) and differentiable on (0,00). 


Proof. Let 
4(1—e~*)cosax, x >0,t>0; 


flat)={ ? r=0,t>0. 


Then f(z,t) is continuous on [0,0o) x [0,00). For a 4 0, we see that if cos= dx, which 
is independent of t, converges uniformly on [0,00). Since 1 — e~** is monotone on t and 
|1—e~**| < 2, Abel’s test concludes that F(t) converges uniformly on [0,00) and so F(t) is 
continuous on [0,co) by Theorem 7.17. 

Next, in view of the fact that 


fi(z,t) =e“ cosaz, «>0,t>0, 


we see that both f(,t) and f;(#,t) are continuous on [0,0o) x [0,0o). Furthermore, For 
every € > 0, when t > ¢, we have 


[fe(z,t)| < e7™ <e~*, 2x (0,00). 


Since te e “dx converges, the Weierstrass M-test implies that fe fi: (a, t) dx converges 
uniformly on [e,oo). By Theorem 7.19, F'(t) is differentiable on [e, oo). Since € is arbitrary, 
it follows that F'(t) is differentiable on (0,00) and 


F'(tj= | e* cosaa dx. (7.4) 
0 


Calculating the integral in (7.4) gives 


—a«t t 


= (asin ax — tcos ax) |p° 


F()=5 


+ a? ~ 24a." 


Integrating this result yields 
1 
F(t) =5 In(t? + a”) +6, 


where c is an arbitrary constant. Since F(t) is continuous and F'(0) = 0, we find that 
1 


?+a? 
F(t)= 5 In a2 
This echos the fact that F' is continuous on [0, co) and differentiable on (0,0). 
When the range of parameter t also becomes infinite, in order to switch the order of 
integration, Fubini’s theorem (Theorem 7.18) requires further conditions. 
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Theorem 7.20 (Fubini’s Theorem). If f (x,t) : [a,00) x [c,co) > R satisfies 


1. f(x, t) is continuous on [a, oo) x [c, co), 


2. The improper integrals 


a f(x,t)de and a f(x, t) dt 


exist and converge uniformly for x and t restricted to every finite interval, respec- 
tively, 


3. One of the integrals 


ae ie f(,t)|dedt and ff we@olaac 


CcOnvET GES, 


then both integrals 


i< i Fe iande- dnd i ‘_ FCB cde 
a a (2,0) acat = [ [ Ff (w,t) dtde. 


Proof. Without loss of generality, we assume that [™ [-° |f(«,t)| dtdx converges. The 
Cauchy criterion implies that f° [°° f(«,t) dtdx converges as well. Thus, 


Ef f(a,t)dxdt = ima ia f(a, t) dadt 


love) R 
= lim / / f(a, t) dtdx. 
Roo Jaq ei 
Notice that 


a ste.atde= [> f° fat)dtdes ff f(a, t) dtda. 


It suffices to show that 
im, [- ie. f(a, t) dtdx = 0. 


To see this, for every € > 0, in view of that oe J-° | f(a, t)| dtdx converges, there is A > a 


such that 


For fixed A, since iia f (ax, t) dt pee converges on x € |a, A], it follows that there is 
R’ > c such that 


converge and 


if f(a, t) a < aa for every x € [a, A] and 6 > R’. 
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Hence, for R > R’, 


7 [ flethdtde + fo i f(a, t) dtdx 


< ip Ir ~~ a f(a, t)| dtdx 
< a a+ fo i’ | f (x, t)| dtdx 


eo 
at eae 


f(a, t) dtdx 
R 


This completes the proof. 


The following example indicates that Condition (3) in Theorem 7.20 is necessary. 
Example 7.13. Consider 


t? — x? 
(a? + #2)2” 


ic t? — x? re A 1 
a (e+e) = Aa ue 


by the Cauchy criterion, the improper integral ie ao dx converges uniformly on t € 


f(a,t) = (x,t) € [1, 00) x [1, 00). 


Since 


[1,00). Similarly, the improper integral ahaa ao dt also converges uniformly on x € 
[1,co). Thus, f(x, t) satisfies the conditions (1) and (2) in Theorem 7.20. But, we have 


LD exape)e--ae [0 crepe) en 


Direct calculations show that both integrals 
co co t? _ co co t2 _ hie 
/ ‘| AP loa) gee ¥; i) Me Se aay 
1 no ey 1 a Cane 
diverge! 


If, : ee that f(a,t) > 0 on [a, oo) x [c,d], we show that the uniform convergence 
of {5° f(x, t) dx on [c,d] becomes a necessary condition for the continuity of I(t). 


Theorem 7.21. Let f : [a,co) x [c,d] > [0,00) be continuous. If I(t) = Jy° f(x, t) dx is 


continuous on [c,d], then ie f(a, t) dx converges uniformly on [c, d]. 


Proof. Rewrite 


w= [4 f(a, t) yao Sof Floste = Yon 


+n-1 


where 
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By the assumptions of f, we see that a,(t) is continuous and nonnegative on [c,d], and so 
the series }°°°_, a,,(t) converges uniformly on [c,d] by Dini’s theorem (see Example 5 in 
Section 6.5). Thus, for any € > 0, there is some N such that 


Co 


S- an(t)<e for any t € [c,d]. 
n=N+1 


We now choose R=a-+N. For A > R, in view of the fact that f > 0, we have 


CO 


: f(a,t) da < f(a,t) dx = S- an(t)<e, for any t € [c,d]. 
A N+a n=N+1 


This proves that {* f(a,t) dx converges uniformly on [c,d]. 


This theorem, together with Theorem 7.20, suggests the following theorem in which that 


the continuity of the integrals [~~ f(a, t) dx and f~ f(a, t) dt justify us to switch the order 
of the integration. 


Theorem 7.22 (Dini’s Theorem). /f f (x,t) : [a,oo) x [c,00) > R satisfies 


1. f(x,t) is continuous and nonnegative on [a,co) x [c, oo), 


2. The functions I(t) = f-~ f(x,t)dx is continuous on [c,oo) and J(x) = 
J-> f(a, t) dt is continuous on [a, ov), 


7 I(t)dt and 7 I(x) dex 
f i 


3. One of integrals 


converges, 


[wa-f f fle,t)dede = f a(eyae= ff flo,t) dtde. 


Combining this with the Weierstrass M-test, we have the following theorem which will 
be needed to justify the desired steps in most of our subsequent discussion. 


then 


Theorem 7.23 (Extended Fubini’s Theorem). /f f(x, t) : [a,0o) x [c,oo) > R satisfies 


1. f(a,t) is continuous on [a,co) x [c, oo), 


2. The improper integrals 


a Petae ond [ Fla,t) dt 


both exist and converge uniformly fort and x restricted to every finite interval, 


respectively, 
B 
[ fedar 
A 


3. For B>A>a 
< M(t) 
and f,~ M(t) dt converges, 
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| i | ” f(a,t) dedt = | . | ” f(w,t) dtd. 


As a powerful application of this theorem, in view of 


1 [oe) 
-—= Mi e** dt 
w 0 


after verifying that f(x,t) = e~* sin x satisfies all conditions in Theorem 7.23, in one line, 


we recover the result that {5° “2 dx = % (see Example 7.4). 


| (/ et sins dt) dx =i (/ et sind) dt = i 5 = Ls 
0 0 0 0 o ilt+t 2 


We end this section by establishing another classical result: 


I -| er eee (7.5) 
: D 


then 


This formula frequently appears in the formulas of the gamma function in the next section 

and plays a central role in probability theory. There are many ways to calculate this integral. 

The method used here is based only on a substitution and Dini’s Theorem (Theorem 7.22). 
For u > 0, the substitution x = ut leads to 


I =} ue” © dt. 
0 


par] o“au= | Ie“ du 
0 0 
ayy i ue” OF) dedu 
0 Jo 


- i (/ ueW" (144) iu) dt (using Theorem 7.22) 
0 0 


-{° ae dt on 
es he 2(1 + t?) ~~ 2fo 1402 4 


0 
and so I = \/7/2, which confirms the formula (7.5). To justify the interchange the order of 
14t?) 


Hence 


integration, we verify the three conditions in Theorem 7.22. Clearly, f(t,u) = ue ( 
is continuous and nonnegative on [0,0o) x [0,0o). Moreover, 


pu) = ir f(t,u) dt = ew ie e~ (wt)? d(ut) = Ie 


is continuous on [0, oo) and 


1 


is also continuous on [0,00). Moreover, ee w(t) dt converges. Thus, Theorem 7.22 is appli- 
cable. 
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7.3. The Gamma Function 


Yet the record is this: each generation has found something new of interest to say about 
the gamma function. — Paul Nahin 


The gamma function was introduced into analysis in the year 1729 by Euler while seeking 
a generalization of the factorial n! for non-integral values of «x. Initially, he expressed his 
solution in integral form 


1 
zl = | (— Int)” dt. 
0 


Later, Legendre proposed the notation I'(a) and the now standard definition of the gamma 
function. 


Definition 7.6. For x > 0, the gamma function is defined by 
T(x) = | ite ae, 
0 


A change of variable show that ['(x + 1) is the same as Euler’s definition x!. Moreover, 
using integration by parts, we find that 


T(a+1)= i: Pe daa | t?—1e—* dt = aI'(2). (7.6) 
0 ) 
Since ['(1) = 1, for n € N, applying (7.6) repeatedly yields that [(n + 1) = n!. A graph of 
the gamma function is shown in Figure 7.1. 
The graph suggests that I(x) is a convex function. In fact, we have the following stronger 
property. 


FIGURE 7.1 
Graph of y = T(z). 
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Theorem 7.24. InI(x) is convex on (0,00). 


Proof. Recall the definition of convex (Definition 4.3), we assume that 0 < a < b and 
0<a<1. Then 


T(aa+(1—a)b) = / em ie 
0 
/ at)" ; i) dt 
0 


fore) Qa fore) l-a 
(| ite it) (/ ee it) 
0 0 


Nay rey =. 


IA 


l| 


where Hélder’s inequality has been applied with p = 1/a,q = 1/(1—q). Taking logarithms 
of both sides yields 


InT(aa + (1 —a)b) < alnT(a) + (1 —- a)P (0), 


which shows that InIT'(x) is convex by definition. 


The graph of InT'(z) is displayed in Figure 7.2. 
Remark. Given f : I > R, if In f(a) is convex on J, i.e., for any 0<a<1,a,b€TI, we 
have 
In f(aa + (1—a)b) < aln f(a) + (1—a) In f(b). 


Taking exponents on both sides, then using the weighted AM-GM inequality (4.3), we have 
f(aa+(1—a)b) < f(a)“ f(b)* < af(a) + (1— a) f(b). 
This implies that f itself is convex. Thus log-convex is a stronger property than convexity. 


Since the time of Euler, mathematicians have wondered if the log-convex of I(x) can 
be of any use. Surprisingly, Bohr and Mollerup discovered that the gamma function is 


3.5 
3.0 
2.5 
2.0 
1.5 
1.0 


0.5 


FIGURE 7.2 
Graph of y = InI(z). 
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actually characterized by this property—having fixed the integer values of the function, the 
logarithmic convexity will restrict the growth of the function in such a way as it must be 
the gamma function. For the following theorem, Davis [35] once said: “The proof: one page. 
The discovery: 193 years.” 


Theorem 7.25 (Bohr-Mollerup Theorem). /f a positive function f(x) on (0,00) sat- 
isfies 

Lf) =1, 

2. f(a +1) = «f(2), 

3. In f(x) ts conver, 


then f(x) =T (a). t.e., the gamma function is the only function satisfying the three proper- 
ties. 


Proof. The hypotheses (1) and (2) imply that f(n +1) =n! for alln € N. By (2), without 
loss of generality, we consider 0 < x < 1 only. For any positive integer n and for0 <a <1, 
we write 

nt+a=(1—a2)n+a2(n+1). 


Then by the convexity hypothesis (3), 
Inf(nt+a)<(1—a2)Inf(n)+a2ln f(n+1), 
or equivaletly 
f(nt2) < fn) *f(nt1)* = ((n— I) F (nl)? = nine. (7.7) 


Along the same lines, the convex combination 


nt+l=a(n+a2)+(1l-—2)(n+2+4+1), 
together with f(n+v+1)=(n+2)f(n+4+ 2), gives the inequality 
nl =f(nt1)< f(nt2)*f(ntaetl)*=f(ntaz\(nt+z2)*. (7.8) 
Combining inequalities (7.7) and (7.8) yields 
ni(nta)*' < f(nta)<nln™?. (7.9) 


Applying 
f(n+a2)=(n+a-1)(n+a-2)---(¢4+1)zf(z) 
to (7.9) leads to 
ni (n+ 2)” < f(a) < n!n® 
u(x +1)---(w~@+n) — ~ a(a@+1)---(@+n—1)n 


Rewriting this as 


ni n® (n+ 2)* nln” ztn 
sett) tn ne “FSi y- +m) on 


then letting n > oo, by the squeeze theorem, we find that 


ni n® 


ae ar a(a+1)--+(~@+n)’ 


Hence f(x) is uniquely determined by (1)—(3). Since I'(a) satisfies (1)—(3) as well, it follows 
that f(x) =T (2). 
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As a by-product we recapture the Gauss product formula: 


nl n® 


li 
00 xa(a+1)---(a4+n) 


T(x) = (7.10) 
In fact, the formula (7.10) is Euler’s original construction for x!. But Gauss rediscovered 
this formula and recognized its importance. 

Implicit in the above calculations is the following generalization of Stirling’s formula 
nl ~ V2rn(n/e)”. In fact, for any 0 < a < 1, (7.10) can be rewritten as 


_ T(n+a+t+l) 
lim ——_——— = 1. 
n—¥00 nine 
Applying Stirling’s formula for n! in this limit gives 
: Tinta) | 
ER Gai. 


or 


lim (n+ a)[(n +a) om 


e366 (n+ a)rteti/2 e-n-a 


where the fact that (1+a/n)” > e® uniformly on (0, 1] has been used. This establishes the 
following Stirling’s formula for the gamma function. 


Theorem 7.26 (Stirling’s Formula for [(x)). As «> «, 
T(2 +1) ~ Vine (=) (7.11) 
€ 


A more accurate approximation is given in Exercise 78 at the end of this chapter. 
As another application of (7.10), the following theorem shows that the Gauss product 
formula (7.10) is essentially the same as the infinite product representation of 1/T'(a), which 
Weierstrass used as a definition of I(x). 


Theorem 7.27. For allx € R with « 4 0,—-1,-2,..., 


where y is the Euler-Mascheroni constant. 


Proof. In view of Theorem 2.31, the convergence of the infinite product in (7.12) follows 


from ; ; 
© -#/n = ( 2) a ene eae =e 
(1+ o)e ia ! A dee : erated n3 


and the series }>>°_, 1/n? converges. By (7.10), we have 


1 . &(a+1)---(a%+n) 
—~ = lim 
T(a) — n-F00 ni n® 


x x 
im. (149) (149) 
noo var) 


a 
= Jim get(1t1/24+--+1/n-Inn) Il (1+ =) en a/k 


n—->co 


I 


Co 


= xe” II (1 + =| errr 


k=1 


This proves (7.12). 
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We now return to the Bohr-Mollerup theorem. Aside from its aesthetic appeal, this 
theorem can be used to verify formulas involving the gamma function. 


Theorem 7.28 (Legendre’s Duplication Formula). For x > 0, 


g2a—-1 


Vi 


Deak x g+1 
=-_r(S)r 
fe) = (Sr (FE) 
To show that f(a) =T(a), it suffices to check that f(a) satisfies the three conditions in the 
Bohr-Mollerup Theorem. By (7.5), we have 


T(2x) = 


T(«)P (« +: 5) (7.13) 


Proof. Let 


co are: oo 
T(1/2) -f PR gtge FS a f e-” de = Jr, 


which implies that j 
1) = —T7(1/2)T() = 1. 


f(@t+1)= “0 (FE )r(§ +1) =5r(72)r() ar: 


The logarithmic convexity of f follows at once from that of the gamma function. Hence it 
follows from the Bohr-Mollerup theorem that f(a) = I(x). Replacing x by 2a yields the 
formula (7.13). 


Also, 


Legendre’s duplication formula can be generalized to the more general case. Indeed, let 


m@—1/2 


f(z) = el (=)r (=**) (et), na) 


Clearly, In f is convex on (0,00). Moreover, 


=o) Br) 
( 


metl/2 


fe+)= Giant 


a+1/2 


m xrt+1 xr+2 rt+m—-1l x 

= T T eT T + 1 
amy? (Fe) (FR) (eG) 
mett1/2 xt+1 x+2 cr+m—-1)\ 2 x 

= T T TD T 
(Q7r)(n—1)/2 ( m ) ( m ) ( m )z (") 
mt—1/2 x rt+l1 zrt+m-1 

=o nal (2)r( m Jr m ) 

= rf(z) 

We now show that f(1) = 1, ie., 


paar? P (—) D (=) oT (=) = 
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For this purpose, applying the Gauss product formula (7.10) yields 


k nl nk/™ prt 
hee p= k=1,2,...,m). 
(=) nob00 k(k +m)(k + 2m)--+(k+nm)’ ( »2,...,m) 
Hence eee Se 
a) la ae a ————. (7.15) 
m m m n—+00 (m+nm)! 
Since 


ra) a) PG) = BB Geant 


Appealing to the Stirling’s formula for n!, we have 


(n!)™ (29) SO Neate)? 


(nm)! mrm+1/2 


(m—1)/2 
ag ea rn pe 
m m m mi/2 
This shows that f(1) = 1 and so f(#) = T(x) by the Bohr-Mollerup Theorem. Moreover, 
replacing « by ma in (7.14) results in 


Therefore, 


Theorem 7.29 (Gauss Multiplication Formula). Form €N,xz > 0, 


T(mz) = ee T(2)P (« + =) aD (« + a) (7.16) 


m 


Another significant consequence of the Bohr-Mollerup theorem is that it enables us to 
associate the Euler beta function with the gamma function. 


Definition 7.7. For x,y > 0, the Euler beta function is defined by 


B(z,y) = [ #?-1(1 —t)9"? dt. (7.17) 


During his search for the definition of x! and the systematic building of the formulas of 
integrals, Euler introduced (7.17) based on Wallis’s formula. The following theorem reveals 
a striking relation between the beta function and the gamma function. They are commonly 
used to evaluate a number of integrals. 


Theorem 7.30. For all x,y > 0, 


T(x) Ty) 


B(az,y) = tesa 


(7.18) 
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Proof. For each fixed y € (0,00), let 


I(x+y) 
ly) 


We now verify that f(x) satisfies all three conditions in the Bohr-Mollerup theorem. First, 


f(x) = B(az,y), x € (0,00). 


T(1+y) 


Bil, y) = yB(1,y). 


Since 
1 ai 1 
Bay) = [ a-atae= | wl du = -, 
0 0 y 


it follows that f(1) = 1. Next, rewrite 


1 1 x 
Be +1.y) = [ (ot tay = f (4) (L—pyetee dé, 


Integrating by parts yields 


2 [t= e4 | Paap. ae a: 
Beet iy) =[-CS) 4 f CoO t= So Ben). 
Thus 
ay T(ety+)) _(tyPety) « = 


It remains to show that In f(x) is convex. Notice that 
In f(z) = InT(a# + y) + In B(z, y) — InT(y). 


Since InI'(a+y) is convex for x (Theorem 7.24), it suffices to show that In B(x, y) is convex 
in x. The proof follows the same lines as that of Theorem 7.24. Let 0 < a < 1. Then 


1 
B(aa+ (1—a)b,y) = i PPE OE ( Te Ge 


=f (era-9rys ayy ae 
0 


lyn to-1 (1 — t)9- pate aoa) 
=B 


(a,y)* Bib, y)*. 


l-a 


Taking logarithms yields 
In B(aa oh (1 =o a)b, y) < aB(a, y) + (1 = a) Bib, y). 


Hence In B(x, y) is convex and so In f(a) is convex. By the Bohr-Wollerup theorem, f(a) = 
I(x). This demonstrates (7.18) as stated. 


As a consequence of (7.18), together with the properties of the gamma function, we 
obtain 


Theorem 7.31. For p,q > 0, 
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1qa+1) = grariery BO.9). 
(3). B(p,q) is continuous and has continuous derivatives of all order on (0,00) x 
(0, 00). 
By the recurrence relation of the gamma function, for x € (0,3) \ {1,2}, we define 
T(3 — 2) 
@-a\-2) 


T(l-2):= 


Then, for any x € (0,1), 
T(a+2)0(1 — (a + 2)) =T(a)P(1 - 2). 


This indicates that the product I'(a)I'(1 — x) is a periodic function with period 2. It is 
well-known that sina is also a periodic function with period 2. However, who could an- 
ticipate that they can be expressed in terms of each other? Davis [35] poetically describes 
the following relation (7.19) as “a fine example of the delicate patterns which make the 
mathematics of the period so magical.” 


Theorem 7.32 (Euler’s Reflection Formula). For 0 < «<1, 
7 


T(a)C(1— 2x) = 


(7.19) 


sin 7x 
Proof. There are many different proofs (real and complex variables) of this formula. Here 
we present two real number proofs. The first one is based on the beta function and partial 
fraction decomposition for csc x. The second is to apply the Sine infinite product (6.21) and 
the infinite product formula (7.12). 


Proof I. By (7.18), we have 
1 
I'(x#)\f(1—2) = B(z,1-2z) = | #?-1(1 —t)-* dt. 


0 
Applying the substitution u = t/(1 —t) yields 


foe) x—1 1 a—l fore) x—-1 
rer a) = f u au= | du / er 
9 tlt+u 9 itu 1 lt+u 


Notice that the substitution y = 1/u gives 


foe) a—1l 1 -—2£ 
fi x du = i dt dy. 
1 Il+u 9 ity 


Hence 
r@yra-a)= f "4 
x -—x2)= U 
0 1lt+u 
1 1) -a«x x 
a—1 U i 
= u aut [ du (use > =1- 74) 
[ 0 lt+u 1+ 1+ 
1 _ 
=2+f (u-® =u) 3 (-1)" w" du 
4 0 n=0 
1 : = n —@rZ+7Nn zr+rn 
=2+ f opr — ut) du 
< 0 n=0 
_ or yr 1 1 
2 ; n+ax n-2x 
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In view of (6.23), we arrive at (7.19) as desired. The justification of the term by term 
integration is as follows: Let S,,(u) and R,(u) be the nth partial sum and remainder of the 


series )yP-9 (—1)*u*(u-* — u®). We show that to R,,(u) du > 0 as n + oo. In fact, 


fren fay fl yn (MY in 
» 0 l+u F Ta 


Since 0 < x < 1, the function (u'~” — u**)/(1 + u) is continuous on [0,1], and so there is 
a M > 0 such that (u'~® — u!*®)/(1+u) < M for all x € (0,1). Thus, 


1 1 M 
| IRn(w)|du ca | u” du = —— +0 asn— ov. 
0 0 n+1 


This completes the proof. 


Proof II. By the recurrence relation and the infinite product representation (7.12) of 
T(x), we have 


1 1 
I(x2)P(1 — 2) T(a2)(—a2)T(—2) 
— x x 
= yr yr 1 =) —a/n. (1 = *) a/n 
xe'"e I ( ate e fs e 
— x 
= es es 
(a) 
In view of the sine infinite product (6.21), we conclude that 
1 _ sintx 
I'(2)P(1—- 2) nT? 
which is equivalent to (7.19). 
As a powerful application of (7.19), the expression P := se T(k/m) can be recap- 
tured as follows: 
m-ie(8) feo) 
m m 
k=1 k=1 
= k k 
=|[ r(—)r(i-— 
Fae m m 
a ae = qm-l (Qa? 
wor Sin) Tea sin (#) m 


Again, we obtain 


Finally, without utilizing the complex contour integration, we calculate a special integral 
based on only the standard properties of the gamma function. This integral will be used to 
derive a functional equation for the Riemann zeta function. 
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Example 7.14. For0 <a < 2, show that 


| x “sina dx = aI (a) sn(anya)’ (7.20) 


Proof. First, for « > 0, replacing t by xt yields 


T(a) = i] te-te—* dt = x | tote * dt. 
0 0 


Next, choose € > 0, let 
co 
I(e) = if e “a “sina da. 
0 


Then 
1 - a-l ett 
I(e) = =~ e “sing a dtdx 


(a) 


1 
= Es), to ‘E: —2(e+t) sin » dadt 
a) 


1 
= no ft a 


Here the factor e~*’ makes the integrand absolutely integrable on [0, co) x [0, 00). By Fubini’s 
theorem, the interchange of the order of the integration is justified. Moreover, recall the 
remark after the Dirichlet’s test (Theorem 7.14). It implies that i ea“ sina dx is 
uniformly converges on [0,00), so I(€) is continuous and 


co Sane ; 1 oo 40: 1 
i x sine de = tim Te) = 55 f ia 


To compute the last integral, by the substitution u = t?, we have 
co 4a-—1 co ,,a/2-1 1 
i t a-= f . j= B(S,1 =). 
9 1+? 2Jyo ltu 2 2 2 
Applying (7.18) and (7.19) gives 


B55 aN) es) aa 


which proves (7.20). 


—at 


7.4 Worked Examples 


There is no subject so old that something new cannot be said about it. 
— Fyodor Dostoevsky 
You are never sure whether or not a problem is good unless you actually solve it. 
— Mikhail Gromov 


In this section, we collect some problems to demonstrate the calculations and applica- 
tions of the improper integration. 
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1. 
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Test the convergence of 


ice dx 
r= f a es “i 


1+ 2%| sin 2|? 
Solution. We consider four cases. 
(1) Assume a < 1. Since 


1 1 
1+ 2%|sinz|® ~ 1+ 2°’ 


by the comparison test, the integral diverges. 
(2) Assume that a < 8. we have 


co (n+1)r 
r= yf” da 


dam 1+ 2%| sin 2|? 


af dt 
az rag 1+ (nz + t)%| sin ¢|P 


ie) 1/(n+1)r dt 
yy | 1+ (nm + t)| sin t|f 


n=0 

1 1 
Sy : 
— 27 =e n+1 


IV 


Co 


In the last inequality, we have used the inequality: If 0 < ¢ < 1/(n+1)z, 


B 
1 
(nm + t)*|sint|? < (n+1)%r?t? < (n+ 1)? x? (x) =1 


Here the divergence of the harmonic series implies the integral diverges. 
(3) Assume a > 6 > 1. Observe that 


ye dt aa dt 
= =h+h. 
= 1+ (nm +t) sin t@ “yp Tp tare ese? 1+ de 


For t € (0,7/2) and n > 1, 


B 
2 
(nm +t) sint? > (nz)* (2 t) =n%cFt?, (with ¢ = 2n%/8-1), 
T 
in which the well-known inequality sinx > 24 has been used. Thus, the general 
term in J; does not exceed 


m/2 dt 1 n°! on/2 dt C 
= < 
i 1+n%cbth = n/Pe | 1+t8 — neo/B’ 


where C, = i le ite: The p-series test implies that J; converges. By a similar 
approach, we see that Jj converges as well. 

(4) The leftover case: a > 1 and a > 8. Taking a number 7 > @ such that 
a@ > > 1 converts this case into case (3). So the corresponding integral converges. 
In summary, we have that the integral J converges if a > max{1, 3} and diverges 


if a < max{1, G}. 
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2. If f(x) > 0 is decreasing, show that f-* f(x)dx and [™ f(x)sin? dx both 
converge or both diverge. 


Proof. Since sina < 1, by the comparison test, it follows that (ia f(a) sin? x dx 
converges if ae f(a) dx converges. We now prove the converse by contradiction. 
Assume [~* f(x) dx diverges. In view of 


es 
ie f(x ye = i x) dx 
atnn 


and the assumption that f is decreasing, we have 


at(n+1)r 


7 Hat nn) 2 a x) dz =o. (7.21) 
a+tnr 
On the other hand, we have 
n+1)r 
ig f(a) sin? edz = : i f(a) sin? «dx 
a+tnn 
oo at+(n+1)r 
Pa f(a+ (n+ 1)r) sin? x dx 
n=0 a+tnn 
love) at(n+1)r 
=¥ fla+(n4nm f sin? a dx 
n=O a+nt 


= 5 SE fiat (n4+1)z). 


This implies that [~~ f(x) sin? dx diverges from (7.21). 


3. Let f,(x) : [a,co) + R converge to f(x). If 


(1). For any A >a, fn converges uniformly on [a, A], 


(2). [° fn(x) dx converges uniformly on n, 


prove that [~~ f(x) dx converges and 
f(x) dz = lim 7 fn(x) dx 
Proof. By the assumption (2), for any € > 0, there is R > a such that 


x)dx|<e whenever B> A> Rand for allneN. 


Since f, converges uniformly to f on [A,B], by Theorem 7.7, letting n + oo 
leads to 


x) dx) <e€ 
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This implies that [~ f(x) dx converges. Now we choose A’ > a such that, for 
every n EN, 


€ 
<=. and 


f(a) dx 3 


A’ 


By (1), there is an N such that 


lfn(x) — f(x)| < aa) whenever x € [a, A’]. 


Thus 


ja Pie [ eve 


< file) sole |f fata) 


This proves the stated limit. 


Remark. Recall from Theorem 6.7 that the uniform convergence on [a, }] is the 
only requirement necessary to switch the limit and integral. For the improper in- 
tegrals, the following example shows that the additional condition (2) is necessary. 


ae la) = 4, 0<a<n 
n(a) = { 0, «>n? 
Since 0 < fp(x) < 1/n? for all x € [0,00), f, converges to 0 uniformly. But 
= can 
Jim, : fn(x) da = Jim, ea dx =0 £0. 
4. Another real number proof of (7.18). 
Proof. Begin with 
B(«,y+1) = ia 1(1 —t)¥ dt 
ae 1(1-—#)(1—#)9"1 dt 
= B(x,y) — B(x + 1,y). 


On the other hand, integration by parts gives 


Bays i= | *(l ~ 1)" d(t®) 


1 y 7 
=f (1-2) +2 [ (1 -t)¥ 1 dt 
—t( b+ f (1—t) 


= “B(x +1,y). 
xv 


Worked Examples 377 


Combining these two equations yields 
L+ 
Blx,y) = ares B(x,y + 1). 


Repeatedly using this identity gives 


= (aty)(a+ty4+1)---(a@+y+n-1) 


yytl)--(ytn—1 B(x,y +n). 


Keeping the Gauss product formula (7.10) in mind, we rewrite B(x, y) as 


Ae Ai) ese Inv 
bays CIWS y+1)---(@tytn)ninY ytn Cees 
y(y +1)---(ytn)nlnety atytn 

ytn («+y)(e+y4+l1)---(e+y4+n) nnd nt 
atytn ninety yy +1) (yn) 

1 

fea-one a 

0 
__ ytn (et+y)et+ytt)---(@t+y+n) nin¥ 
atytn ninety yy +) (+n) 


at ytn-1 
i a (1 - ~) du. 
0 nr 


Letting n > oo, then invoking the Gauss product formula (7.10), we find that 


T bis y+n-1 
B(z,y) = aw lim ; u*" (1 - “) du 


T(x +y) noe n 
_ Ty) i. u®—le-* dy — LEY) 
T(ie+y) Jo T(a+y)’ 


where the limit process is justified by the Dominated convergence theorem. 


Remark. Here we have taken advantage of the integral definition for ['(a). Since 
we have the powerful tools of integration such as integration by parts and change 
of variables, we can deal with related properties of the gamma function more 
efficiently. As an example, we give another beautiful derivation of (7.18) due to 
Jacobi. Rewrite 


D(x)T'(y) = ete at | si-te8 as= | | 7-1 54-1 e—(5+ dade, 
0 0 0 Jo 


The equality of the iterated integral and the double integral is justified by the ab- 
solute convergence of the double integral. On the other hand, making the change 
of variables: 

s=uv, t=u(l—v), 


which is initially suggested by u = s + t, we find that 
(u,v) € (0,00) x (0,1) if (s,t) € (0,00) x (0,00). 


Since 
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we find that 
y= fr fw 11 — v)* tutu teu dudu 
i 
or urtyot edu | v¥(1—v)*—"1 dv 
0 0 
=T@+y)Bly, 2). 
(7.18) now follows from B(x, y) = B(y, x). 


Evaluate ih = sin’ 2 dz. 


Solution. Appealing to the identity 
sin(2n — 1)a — sin(2n — 3)a = 2sinx cos 2(n — 1)a, 


for each n € N, we have 


a a m/2 os - mw/2 os 
po meee Pee [ead 
0 0 


sin x sin x sin x 2 


Next, in view of the identity sin? na — sin?(n — 1)” = sin(2n — 1)asin 2, we have 


sin?na — sin?(n — 1) a3 sin(2n — 1)x 3 sin(2k — 1)x de. 
sina 


sin? & sin? ¢ sin x = 
Hence 
dic sin® na: ne sin(2k — 1)x 1 
=> dx = =n. 
0 sin? x sin x 2 


Applying the well-known ae x — «°/3! < sing < 2 for x € (0, 7/2] yields 
1 i sin? na me 7 1 Me ney, 
n Jo x? 2 n Jo sin © 
4 (7? ge ce a 
| sin ae (1 ) i 
n Jo x 6 
1, fd n\~? 
Ss Seis) aie 
> n | ge ( =) i 
Using the substitution x = t/n, then letting n — oo leads to 


a aE Be ; 6? mae sin’ a. 
0 x 2 6 0 x? 


Since 6 is arbitrary, it follows that 


°° sin? ae T 
; dr = —. 

0 x 2 
© sing T 

dx = —, 

0 x 2 


using integration by parts, we simply have 


© sin? x ~ Asin x cos x © sin 2x T 
side =f EOS ae = de = 7. 
0 xv 0 x 0 x 2 


IA 


Remark. If we know that 
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6. 


(Monthly Problem 12288, 2021). Prove 


Proof. Let the proposed integral be I. The substitution « = 1/t leads to 


= 7 (#7 — sin? t)? 
0 


t6 


Rewrite I as 


| (1 — a? sin?(1/2))’ dz = = 


t? — sin? t 
In dt 


dt. 


r=2f a 


In general, this suggests us to consider 


oo yn 
Ts, =) 
0 


tnt2 


sade ee ng 
i) dt 
0 te 


—sin” t 


dt 
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where n > 2 is a positive even number. We now evaluate J, via the Laplace 
transform. Recall that 


We find 


2 
n+1 


tk = tk —st qt — es, 
cit|= [teat Fa 


k) 


Co Co 
| grt} i (t” — sin” t)e~** dtds 
JO 0 


wa f° lM 0)~ chine ato) a 


n! 


Co 
grhtl n! 
Jo er 


Ss 


Ss 


n 


(s2 + 22)--- (62 — ae 


is ¢ (242) 


where we have used the fact that 


which results from 


s”L[sin” ¢](s) = L{(sin” t)"](s) = n(n — 1)L[sin"? t](s) — n?L[sin” t](s). 


L{sin” t](s) = 


In particular, we have 


1 
h=5 


and 


co 62 
_——————— — 
| ( yr} ae 


n(n — 1) 
s2 +4 n2 


4 


Ss 


am) 


Lisin"~? #](s), 


1 
(er 


) 


(s 


<=) ds 


o_o 


a 64 
3(s? + 42) 
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Hence 


In general, we challenge the reader to prove that 


[(n—1)/2] 


meme Dy CONG) mane 


and that for any n €N, 
i (1-2? sin?(1/a))" dx 
0 


is a rational multiple of 7. 
(Monthly Problem 12281, 2021). Evaluate 


°° / cosha 1 
| (=> = =) (In x)? dz. 


Solution. Let u = (Inx)? and v = 1/2 — 1/sinhz. Since 


1 des eek Ce 28 3 
- Gone Go sen o(a’) (for a nearby 0), 


integrating by parts yields 


a, sh 1 mY 1 1\ 1 
I = cos ra ~ —) (ne)? de = 2 | BO a. 
0 sinh* a =x? 0 sinha «/) « 


Recall the partial fraction expansion: 
1 1 eae Vi 
= + Qa : 
sing « 2d x? — nn? 


This implies, together with sinh « = —isin(iz), 


i 1 ae en 
ete. 
sinh x x ae +n? 


Hence, 


= re Ing 
= 4 —1)” 
2 | nea @ 
For a > 0, we have 
cael 1 (© In(at 
i ap = -f me) 4; (use x = at) 
0 v-+a a Jo +1 
1 Ina ° Int T 
= = t .—— dt) = — 1 
-(f apie | t? +1 ) Tao 
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because 
[ Int [ Int rf Int 
dt = 
9 +i 0 P+" P+i" 
=e Int =f 
a Pai" 
Let a = nz. Finally we find that 


p=a5, Citnten) "n(n t=a(y0 cutie "Inn +o cree) 


1 
=9 vate In? 2) ~m2inz) = In2(27 —In2—2lnn), 


where ¥ is the Euler-Mascheroni constant. 


8. Let f(x) be monotone on [0, 00). If Pe f(a) dx converges, prove that 


lim, h 2d f (nh) =| f(x) dx. (7.22) 


Proof. Without loss of generality, we assume that f is decreasing. In this case, 
f is nonnegative on [0,0o). Indeed, if there exists some x such that f(xo) < 0, 
then 


A 
/ f(a) dx < f(xo)(A — 2%) 4 —co (as A > ov), 
which contradicts the convergence of the integral. Therefore, for every n € N, we 


heve (n+1)h n nh 
| Fle)de RY FURR) < | f(a) dex 


This implies that S,, := h>°7_, f(kh) is monotone increasing and bounded from 
above. Letting n — oo yields 


| Fle)de mY? FURR) < : fla) de 


This proves (7.22) as desired by letting h + OT. 


Remark. Applying (7.22) with f(x) = sina/x recaptures the result of Example 
7.4 as follows 


9. (Frullani Integral). Let f : [0,0o) — R be continuous and a,b > 0. If f(oo) = 
limz-oo f(x) exists, show that 


[ Flam) = SUPE) 3-06) F(a) in (7.23) 
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Proof. We establish the convergence of the integral in the process of the compu- 
tation. For 0 <r < R < o, using substitution yields 


tee f (ax) re Rf (ba) 
[PH aon [Hae f° Ba 


fe) eof 1S, 

ar v br x 

OD) i af LD (7.24) 
ar x aR x 


Applying the first mean value theorem for integrals to the two integrals in (7.24), 
respectively, gives 


br br GA 
PO ac= 6) [= f@m2, (ar <é< mr) 


ar e- 


bR bR 
FO) ae = sn) f a = (myn, (ar << < br). 


aR zt aR & 


Let r + OF and R > ov, respectively. Then € + 0 and 7 — oo. In view of the 
continuity of f, 


lim f(€) = f(0) and Fue f(n) = flo), 


E50 


we conclude that the proposed integral exists and 


[ CA Fe AF ee eee Coy 
0 x 


a 


Remark. In view of (7.24), we obtain two variants of Frullani integral: 


(a) If f(co) = limg.. f(x) does not exist, but for some A > 0, the integral 


~ 
A x 


[ EOD AINE) eats, 
0 x 


converges, then 


a 


(b) If lim,_,9+ f(a) does not exist, but for some A > 0, the integral 


i. flax) ~ f(br) Fok =) n>. 
0 x 


converges, then 


10. (Monthly Problem 11709, 2013). Find 


Sfp dy 
COS( & COS Lr. 
[Sf Fiooste — y) ~ cosa} 
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Solution. The integral value is ¢(2) = 77/6. Let y = zt in the inner integral. Then 


°d * cos(1 — t)x — 
| Ft cos(a —y)—cosr}= | eos se dt. 
0) y ) t 


Interchanging the order of the integration yields 


fore) 1 1 fore) 
1- - dt 1-—t)r-— 
/ =| cos(1 — t)a a= | | cos( Jax cose 
0 & Jo t 0 t Jo r 


Appealing to the variant (a) of (7.23), we have 


°° cos px — cos gx q 
———_—— dr=Il|n{-]. 
0) zt Pp 


Hence 

‘lk [oe] 1 

dt 1-—t)r- _ _ 
| / cos( )a — cosa does i In(1 — #) 

0 & Jo x ty) t 

Since 
—In(1 - t) Se ae 
t 7 = n 


is a positive series for t € (0,1), integrating term by term gives 


1 —In(i—#) Sw Fw cane | n 
i gfe), Gt Dog ee 


n=1 


as claimed. 


Remark. A careful reader may find a missing justification in our interchange of 
the order of integration. To overcome this defect, for R > 0 and y = at, observe 
that 


R x R pl t oo: 
| as | dy {cos(a — y) — cosa} = | i i anise) dsdtdx. 
0 © Jo Y o Jo Ji-t t 


Since | sin(sx)| < 1, the triple integral is absolutely convergent. Fubini’s theorem 
now justifies an interchange of the order of integration. Therefore, 


R x 1 uf R 
d d 1 
i =f YF cos(a y) cosa} = | / al sin(sa) dxdsdt 
0 & Jo Y o Ji-t t Jo 
Ly 1 
= costs) f 1 tds 
0 $ 1-s t 


' In(1 — s) ’ In(1 — s) (Rs) ds 
| ds 4 | 5 cos(Rs) ds. 


Ss 


Since In(1 — s)/s is integrable on [0,1], by the Riemann Lemma (see Example 8 
in Section 5.5) we have 
1 
fr In(1 — s) 
Rc Jo 


cos(Rs) ds = 0. 


Hence we find 


R x 1 2 
. dx dy In(1 — s) T 
lim | cos(x — y) — cosa} = i ds=—. 
0 % Jo Y — ; 0 7 6 


R-0o 
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11. If {>° f(x?) dx converges, show that 


ata Jehan BO. (28) 


Proof. By the substitution u = Ax — B/x, we have 


Ti deehiarce if Nae) (ae 
ie (Cee (re 


Making the substitution « = —B/At in the second integral above yields 


afi (a0 2) dt. 
[i poayanaa J s|(40- 2) a 


This is equivalent to the claimed equality because the integrands on both sides 
are even functions. 


dx 


2 


I 


Hence 


Let f(x) = e~*. By (7.25), for A, B > 0, we find that 


* -(Av—B/2)? =;f[° -uw? 4, — VE 
| e dx AI, e€ du 5A" 


12. Show that, for s > 1, 


Co 
1 1 peo gee) 
s)= = dx. 
) Die ail et —1 
n=1 
This gives an integral representation for the Riemann zeta function. 


Proof. In view of 


n=1 
For fixed s > 1, the series }> ~le converges uniformly on (0,00). Thus, 
A s—l co A 
dz = | ye da: 
I ae 2d 0 

oo nA 

1 s-1 
=f o(e) eta 
“Jo n\n 
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The last series on A converges uniformly. Letting A — oo yields 


[ Fee=re) YS =rie0s), 
0 n=1 


which is equivalent to the proposed equality. 


13. Define the Hurwitz zeta function 


ee 
C(s,a) = aa 
dX (n+ a) 


Show that 


(a) For s > 1, we have 


(b) For0<a<1,k EN, we have 


¢(k, a) = (-1)""*¢(k, 1 a) = 
where f‘*) denotes the kth derivative. 


Proof. The proof of (a) is similar to Problem 12 above. We turn to proving (b). 
Notice that 


OO ak-1l(p-ar _ (_ k-1——(1-a)a 
¢(k, a) — (-1)**¢(k,1- a) = aay | — de 


We show that, via the parametric differentiation, this integral can be related to 


In fact, in view of 


1 = =. 
eee : 
n=0 
we have 
love) —axr co .—(l-a)x 
e e€ 
= d 
F(a) i l-e# | fet 
oy ey 
“4 ata 22, Ol So 
a ee 
ere Cae La 
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14. 
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Using Euler’s elegant partial fraction decomposition (6.20): 


we find that 
f(a) = mcot(ar). 


Taking the (k — 1)th derivative of f(a) gives the desired result (b). 


Remark. The formula (b) is often referred to the reflection formula for the Hurwitz 
zeta function. As an application, note that 


= 1 - 1 1 
= 3 USC 073) ic 
dX Gna) Dd Grape 7 3B (6(31/3) -6(3,2/3)) 
Hence 
= iE = 1 1 F 4 
= t _ eee: 3 
» (3n + 1) 2 Gn fas ~ B.gs (Covlam)) lamays = 35 Wor 
In conjunction with 
= 1 = 1 
= (1—37%)¢(3 
py (n+ 13 oe Gn +a | )6(3), 
we find that 
o 1 1 2 
= 1 —3 & 3 
ss : = =(1—37%)é(3) — Pas 
“ (3k +:2)8 2 35 
Evaluate 


1 
Ro =| InT (a) dz. 
0 
Solution. Replacing x by 1 — x yields 


1 
Ro = ? InT(1 — x) dx. 
0 


Thus, by Euler’s reflection formula, we have 


2Ro = [ »@@ra-a)) dx 


1 
7 ii nm (ae) a 


1 Tv 
nn —= f Insin x dx 
0 


T 


= In(2zr). 


I 


Hence Ro = In V2z7. In general, for x > 0, we have 


etl 
/ InT(t) dt = a(Ing — 1) + Inv2z. 
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15. 


16. 


Evaluate ; 5 
CO ean _ eo 
| —,——_ dz, (a,b>0). 
0 


Solution. We calculate this integral in two different ways: (i) parametric differenti- 
ation (based on Theorem 7.17) and (ii) parametric integration (based on Theorem 
7.16). 


I. Use parametric differentiation. Take a as the parameter and let 
co en ae” _ obo” 
I(a) = | soe 
0 x 


In view of (7.5), applying Theorem 7.19 and differentiating under the integral 
sign yields 


Since I(b) = 0, we find that 


OTe [ (a) aes ay, 


It remains to verify that f(a,a) = (e~%” — *) /x? satisfies the conditions in 
Theorem7.19. In fact, if we define f (0, ae - a a, we see that f(a,a) and fa(z, a) 
are continuous on (0, oe (0,00). For any 6 > 0, we then have 


+ 


\fa(x,a)| = ear” < gobo (for all x € [0, 00) and a € [6, 00)). 


Since {5° e~%*” dx converges, by Weierstrass M-test, Jo. fa(x, a) dx converges 
uniformly on [6,00). Thus, by Theorem 7.19, we have 


< | f(x, a) dx = i} fa(x,a) da, for every a € [5, 00). 
da Jo 0 


Since 6 is arbitrary, this proves that differentiating under the integral sign holds 
for all a € (0,00). 


II. Ves parametric integration. Observe that 


b ax —ba? 
a) e =e 
& xv 


co .-—ax? —ba? le) b 
e€ NE 232) 
(age 
x 
0 0 a 


Interchanging the order of the integration (Theorem 7.18) gives 
b lee) b lee) b 
— 2 1 4,2 Jr a wow! 
Ce dvdt = [ (/ =" du) a= f V— dt = /n(Vb— Va). 
| | a \o ve a 24 


(Fresnel Integral). Show that 


[oe) Co 1 
| sin xz? dz = ; cosa? dx =—,/~. 


This yields 
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Proof. Let x? = t. We have 


me 1 f® sint ~~ 1 [* cost 
3, 2 2 
sina dx = = i — dt; | cos x dz = = dt. 
I 2Jo ve 0 2Jo VE 


By Dirichlet’s test, both integrals converge. We show the result for the first inte- 
gral only. Recall that 


1 2, J —tu? q 
—_— = — € U. 
vi Vr 0 


Formally, we have 
[3 2d sf me(fo [oct au) at 
ina~dxr = = in — 
0 2 Jo 0 Va 
1 ms, a 1 od 
= — | i e-™ sin t dt au=— | pass iee 
Jr 0 0 Tv 0 1+u4 
= 1 7 _ 1 /5 
= JT 2/2 ~2V 2 


Here, however justification of interchange of the order of integration is not easy. 
To avoid this difficult, we introduce the convergent factor e~°’ and consider 


cc sint 
I(a)= e “dt. 
() [ vt 


Thus, for a > 0, we have 


Os, FORE hss 
I(a) = al C. gore) sintdu) dt 
2 i (x ren ie ) 
= — e “ *) sintdt } du 
Vm Jo 0 
2 We d 


JT iE 1+ ve a)?” 


Since |e~#™"+®) sint| < e~¢* and [°° e-* dt converges, by Weierstrass M-test, 
ges, by 


it follows that [°° e~t’+ sin t dt converges uniformly on u € [0,00). Next, we 
g 


show that aie (w+) sin t du converges uniformly on t € [0,00). Indeed, in 
view of the oe limit 
op et sing 
lim = 0, 
t0t vt 


for every € > 0, there is a 6 > 0 such that 


e“ sint . Qe 
vi Vr 
Thus, for any A > 0 and ¢ € (0,4), 


22 2 
/ e+) sin t du 
A 


for any t € (0,4). 


e- sint 2 | 
ce) ea 7” dy 
vt Jvia 

Qe [ 
= “Y dy =e 
Vm Jo 


Worked Examples 


17. 


On the other hand, when t € [5,0o), we have 


2 2 2 
jek +9) sine] < eet) < e™ 


Since 5° e~&” du converges, it follows that {o eu? +a) sin t du converges uni- 
formly on t € [6, co) from the Weierstrass M-test. Combining the arguments above 
confirms that [>~ et’ +2) sin t du converges uniformly on t € [0,00). Further- 
more, since the integral 


Lf cma) au= [- du 
0 0 0 wta 


converges, it follows that 


i (/ g tae) sin tit) du 
0 0 


also converges. This justifies the interchange of the order of integration. 


Finally, in view of 
1 1 


0< < 
1+(u%+a)? ~1+u4’ 


again, the Weierstruss M-test implies that [>° du/(1+ (u? + a)?) uniformly con- 
verges on a € [0,00). By Abel’s test, the integral I(a) also uniformly converges 
on a € [0, co). Thus, 


1 1 du 1 7 
: 2 . 
d. — — = — : 
| sin v x 1m I(a) | 5 1 


The Fresnel Integral Revisited. 


Many Monthly articles [42, 66, 93] have been devoted to determining the values 
of the Fresnel integrals: 


k= | cosa?dz and F,= / sin x? dz. 
0 0 
For example, Flanders [42] considers 
F(t) = if e® cosx2dx and F, (t) = | ec!” sin x? dx (7.26) 
0 0 


and shows that they satisfy the functional equations 


2 2 at 7 
He then solves these simultaneous quadratic equations to find the values of F(t) 
and F,(t). The cleverness of his method resides in the introduction of polar coor- 
dinates, as is usually done to evaluate ie e-* dx. The following solution offers 
a simpler method which does not use the double integral, nor the system of 
quadratic equations. The main ingredients of the method are the consideration 
of some related derivatives and linear differential equations. The method applies 
to a number of pairs of integrals. 
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In analogy of the function pairs (7.26), for t > 0,p € R, we introduce 


F.(p) = | ete cos(px”) dx, F,(p) = i. et sin(px”) dx. 
0 0 
We will prove that 


pF .(p) + tf (p) = tF.(p) — pFs(p) 


and if Z(p) = F.(p) +71 F3(p), that 
aye Ne (7.28) 


2 VPP 
a per VEE 2 SEE VE ED 
Jirr=y 5} t i 9 2, 


Since 


upon establishing (7.28), as an immediate consequence we find 


t+ /f/P+p? 
Fi(p) = Pap 

—t+ /t2 + p? 
F(p) age 


Theorem 7.15 asserts that F.(p) and F;(p) both converge uniformly for all t > 0. 
Hence Ff, and F, are continuous functions of t. In particular, setting p = 1 and 
letting t > 0+, we obtain the Fresnel integrals 


loc) [oe 1 
| cos x? dx = if sina? dr = = z 
0 0 2V 2 


To prove (7.28), for any p € R and t > tp > 0, since 


as desired. 


2,—tz 


tox” |a“e : sin(px)| <x 


2 ,—tx 


|z2e~"” cos(px)| < x2e7 2e—tox? 


2 . 
and {> «e~'°” dx converges, the integrals 


° 2 Of 2 
i, xe cos(pa”) dx and if xe sin(pa?) dx 
0 0 


converge uniformly for any p. By using the Leibniz’s rule, differentiating under 
the integral sign gives 


Fi(p) = — i pete sin(px?) dx, F/(p) = i ae te cos(px") dx. 


Next, integrating by parts leads to 
U 1 nie : 2 —ta? 
OND) o>? ieee asin(pa*) d(e~"* ) 
2t Jo 


1 CO co 
ae -{ etx sin(px?) dx — 2» | wet cos(px") a) 
2t 0 0 


1 D 
— —_F,(p)— = F'(p). 
5 (p) ; PsP) 


Worked Examples 


Similarly, 


F'(p) = 


Finally, solving for F’(p) and F%(p) yields (7. 


We prove (7.28) by observing: 


d —pt+tt 
dp ©?) = 307+ pF) 


Z(p) = 
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= F.(p) + . Fi (p). 


27) as expected. 


i Zp) 
2t-—pi- 


(7.29) 


To solve this equation, instead of using separation of variables, which will involve 
the complex logarithm, direct calculation shows that (7.29) is equivalent to 


a 
dp 
Thus, 


(Z()- Vé=pi) =0. 


Z(p) +t — pi = const. 


Notice that 


= 1 
2(0) = Fe(o)= fet t= 5. 
6 2Vt 
It follows that 
zp) <M 1 Va tt pi 
Po fi=pi 2 12 +p? 


as claimed. 


Remarks. It is interesting to see that this technique is also strong enough to 


capture the parameter integrals: 


G.(p) 


foe) 2 co 5 2 
| e-’ cos (4 ) dx, Gs(p) =i e” sin (5 ) dx. 
0 a? 0 au? 


Neither of these can be evaluated as the double integral via polar coordinates. 
By pursuing the same line of reasoning as used above, we have 


Gop) =4Gs(p), Gs 
Furthermore, let W(p) = 


W(p) = YEe-V? cos(VZp) + 
Thus, 
G.(p) = Ta cos(V2p), 


p) = 
Ge(p) + Gs(p) i. Then W"(p) = 
subject to the boundedness of W(p) and W(0 


Gs (p 


—4G-.(p). 


—4iW/(p). This yields, 
)= Vr/2, 


ive ~¥?? sin(V2p). 


i ee sin(V2p). 


For interested reader, establishing the following formulas shows the wider appli- 


cability of our method. 


[> sin(ata?) cos (4) a 
(2) 


co 
= 2 — 
if e® x?P—! cos(bx?) dx 
0 


a? x? 


| h2 


Co 
2 
i e 0? ¢P—! sin(b”) dx 
0 


where a > 0,p > 0 and 69 = arctan(b/a). 


+ p2 


; 
ree ie 5 (sin 2ap + cos Zap + e tHe) : 


in [5 (cos 2ap — sin 2ap + e774?) , 


os 


)p/2 cos(p6o), 


(p) pr sin(p§o), 
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18. Show that 


Ds 7 a - 7 (7.30) 


Proof. The following proof is based on converting the series into a definite integral. 


_ 1 _ - (n—1)int S T(n)P(n +1) 
Le 7 a (2n)! = T(2n + 1) 


n=1 n=1 n=1 
= S- B(n,n+1) = S- B(n + 1,n) 
n=1 n=1 
oo i 1 oo 
= >. | "(1 —t)""1 de = | t S>[t(1—2)]"! dt 
n+1 0 0 n=1 


7 [ dt aA (t-1)+1),_ 7 

fy #-t+1 2), #-t4+1 ~ 373 
The interchange the integration and summation is justified by the positivity of 
the integrands. 


Remark. Based on Example 12 in 6.4, we have the following generating function 


2 1 (2x)? _ 22 arcsin © 
An) 7 Ji— 2 , 


It enables us to find the exact values for a large class of interesting series including 
(7.30). For more details, see [25, Chapter 18). 


19. (Monthly Problem 12317, 2022). Prove 


ie sin(4r) 4 _ 4463) 
0 ‘eal 


In(tan x) 


where ¢(3) is Apéry’s constant S~°°_, 1/n?. 


Proof. Since sin(4xz) = 2sin(2x) cos(2x) = 4sinx cos x(1 — 2sin? x), by the sub- 
stitution u = tan z, we have 


mw/2 3: oe) 3372) 
tm f ae ae = | 4u(l-u*) a, 
0 0 


In(tan x) Inu(1 + u?)3 


oe Fadl 
4 dt t=u? 
Int( +43 beet) 


We now use the parametric integration to compute the last integral. To this end, 


observe that : 
eae 


: 1 
Pdp= —t?| = 
i. Pint 0 
We have 


renal fe apt = 4 f (fat) dp. (7.31) 


Int ~ 


Worked Examples 


For p € (0,1), let s =1/(1+t). Then 


[ fe w= 1~P(1 — s)? ds 
4g LE a : 


= B(2-—p,p+1)= T(3) 
= 5p PEL PIE@) (use P(1 +2) = aP (2) 
= 500M) (use P@EA— 2) = sate) 


By (7.31) we obtain 


1 —_ 9 7 —_ 
[=-27r iE Bee?) dp = | ee) dx (use v= pm). 
0 0 


sin(p7) 1 sin x 


Recall the Fourier sine series of x(a — x) on [0,7]: 


Co 


a(n — 2) = d re WE sin((2n + 1)a). 


We finally find that 


I= 16 1 i sin((2n + 1)z) aS 
0 


sin x 


167 4S) 


qe 


as claimed. Here we have used the fact that, for n € N, 
a sin nx 0, if n is even, 
—— dz = pees 
9 sine am, ifn is odd. 
This can be derived as follows: For n > 2, 


* sin na de * sin(n — 2)a ce * sinna — sin(n — 2) ae 
9 sing 0 sin x 0 sin x 


= 2 | cos(n — 1)a dx = 0. 
0 


20. (Monthly Problem 11564, 2011). Prove that 


[ e-*(1—e-®) re, 34+V75 
© = in F 
9 «(1+e-2" + e—4% + et + e—8r) 2 


Proof. We prove it using parametric differentiation. Let 


2 e-P@(1 — e- ®*) 
I(p) := dx. 
(p) | yseepeeeepes 
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In view of 
1 — e 10x 
Le +e +e $e = —, 
1—e-* 
we find that 
eee 26 ey, 
I(p) = (1 = €-%*)(1 — 2) Se 10"* de, 
0 ~ n=0 
and so 


I'(p) = -{ é-P*(1 —e-**)(1 —e-**) y ete dy 
0 n=0 


=. ya S- | e-Pr(] _ eg _ e. Caeeae dx 
n=0 70 


- 1 1 1 1 
7 eam p+2+10n oeeeim + pe5eim) 


Here interchange of the summation and integration is justified by the monotone 
converges theorem since the integrands are positive. By the digamma function 


identity 
= 1 1 
va) — $(8) = ; 
dX (- +a n+ 5) 
appealing to ~(x) = d(InT(x))/dz, we get 
T(p/10)0'((p + 8)/10) 


HP) =n 5G + D/10)(p + 6)/10) 


Now, the reflection formula 


ae a ae 
yields 
_, F(1/10)P(9/10) | sin(3r/10) | (3475 
1) =n 53 Aoyr(7/i0) ~ 2 sin(ar/10) =tn( 2 
as desired. 


21. Let n EN. Evaluate 


if 1+ao+---+271 
dz. 
0) 


L+ao+--++a" 


Solution. Rewrite the integral as 


Along the same lines as in Example 7.12, choosing € € (0,1), define 


: 1-2” 
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22. 


Then 


T(€) 


1 1 
| (l—a"t")\&"! de — | g™(1—a"t1)*1 dx (set y = 2+") 
0 0 


1 A esis east ve : a! 
= ; (/ yi /D-1(1 _ y) ‘ay — f (1—y) ay) 
n+ 0 0 


— (( : .) Bi.) (use Formula (7.18) 


n+l n+l 
T(e) ( T(1/(n + 1)) 1 ) 
~ nti \P(e+1/(n41)) T(e+1)/)° 


Since, for e << 1, 


T(z +e) =[(x) +T'(x)e+ O(e’), 
It follows that 
ae oe 1 1 ¥@) ye 
T(a@te) T(z) 14+v(e)e+O(e?) T(x) (a) Oe): 


In view of w(1) = —y and I'(e) = 1/e + O(1), this yields 


He) =~ WU/(n + 1)) +7) +00, 
and so 
T= tim, =-— 5 WO/n +) +7). 


By the Gauss formula (see Exercise 81), explicitly, 


1 T In(n + 1) 1 < 2kr 
ie t l 
al) al el ea toe re 


(2sin om ). 
n+l 


The following problem presents a formula for the digamma function in terms of 
a double integral. 


(Monthly Problem 11937, 2016). Let s be a complex number not a zero of 
the gamma function ['(s). Prove 


Yardy PO — we 
ee tg tev = Fy = 80) 


Proof. Denote the double integral by S. Expanding 1/(1 — xy) into a geometric 
series yields 


= C2) ied 
S = ae “at “ye dxdy 


= [Ss “4 YU Gay vaaiiy, 


Here the justification of the interchange of summation and integration is ensured 
by the terms having the same sign. In view of the fact that, for 0 < ry < 1, 


(xy)* a= i a: 
nan), Oe 
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we find that 
Ca es = ley tar [ ( iat) dady 
= -o(f bh (ay) )*aderdyat — f [ fw a) I dedyit) 
7 oan cP ia cary, 


- - (F-= (4) 


--E(ta-a(*2) 


Since the integrands in the first equality are nonnegative, it allows us to reverse 
the order of integrations. By the definition 


1 1 
y= lim (1+54--4+2-mn), 
noo 2 nm 


we have 


Thus, we can rewrite S as 


- 1 1 
SS aE 


n= 


On the other hand, taking the logarithmic derivative of (7.12) gives 


ve 1 
(s) ae Y(t =): 


n=1 


This proves that 


as desired. 


23. (Fontana Formula). Let H,, = >7/_, 1/i. Show that 


Sse es 
n+1)---(n+i-1) 


% 


1 [oe) 
A, = l | 
pe 2n De 


1=2 


where G; is the Gregory coefficient defined by 


x = 
———~ =1 a % fe 1. 
TCs) +) Ge or |a| < 
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Proof. We give a proof based on the Euler beta function and Frullani formula. 
Since G; = 4, denote 


_ (i—1)!G; 
Sn = Dy n(n+1).+-(n+i-1) 


By using the Euler beta function, we have 


(i— 1)! = fe ak 
a ee (1— a)" dx. 


Appealing to the generating function of G; yields 
: iL i-1 : 1 1 1 
Si oe G,(1— 2) "dr = —— + — ] 2” dz. 
[eee ae) 


Here the interchange of the integral and summation is justified since the sum- 
mands are nonnegative. Thus 


1 n-1 n 
_ ae ne —2 
Sn—-—Sn41 = , (« + aes ) dx 


1 OO e—ny _ e—(n+l)y 
| = dy. (Let y= -—Ina) 
7 0 y 


I 


Using the Frullani formula, for 0 <a < b, 


Co pay _ e—by b 
[a= 
) y a 


we find that 


Notice that 


Telescoping yields 
YS Sn = An-1 - Inn, 


which is equivalent to the desired formula. 


The following two problems offer a method for proving a class of inequality by 
using improper integral. 


24. Let ai, b; (1 <7 <n) be positive real numbers. Show that 


; 1/2 
ee a5 aj Ak aj;Ak 
—}| -2 5° _+4_ «<2v2 CL ee 
» bj ye (bj + bp)? Py (b; + bx) oy (b; + bx)8 


Proof. Define f : (0,00) > (0,00) by 


iqQ= Ge. 
j=l 
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Then, for m € {0,1, 2}, 


a 1 es o™ #2) dr = 1 Ajab 
a [ ae wea iD re! eae a » (bj + dy) mth 
By the Cauchy-Schwarz inequality, for t > 0 
oo 2 oo 1 2 
(/ f(a) de) = (/ le + ose) dr) 
UL eam) (f @+0rFerer) 


er: ar 1 ee 2 : 
| f (a)de+2 f xf*(x) da + ; i fe (a) dx. 


It follows that for any t > 0, 


I 


y) 
C? — 2D, <tDo+ = Do. 


In particular, letting t = (2D2/Do)'/? gives the minimum value over all t of 
tDy + 2D2/t 


CO? = 2D) <2 2( Da D3)'/*, 


which is equivalent to the proposed inequality. 


25. (Monthly Problem 11680, 2012). Let x), x2,...,2, be nonnegative numbers. 


Show that 
(>: 2) < 2r? ae Pi a nd 


w=1 4,J= de 


Proof. We show the proposed inequality is the consequence of Carlson’s inequal- 
ity: if f > 0 on [0,0o) such that f,2f € L7((0,00)), then 


cs fle)ae) aa hs f?(a) dx if a? f2(a) de. 


To this end, let f(x) = 7, xie~**. Direct calculations give 


i: f(a)dx = “he e dr = a 
0 Liaw i 


% w=1 
i f2(a)dx = pe 
de 


yes x’ f?(z)dz = 


Thus, the proposed inequality follows from Carlson’s inequality. 


n 
“han SS 
tr) 


Petrie 3. Bh, 
J 


LC 


Remark. The discrete version of Carlson’s inequality is: 


co 4 co Co 
(> | <7? a an oS nar. 


n=1 n=1 n=1 
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Here we present Hardy’s elegant elementary proof which only used the Cauchy- 
Schwarz inequality. Let 


co 
2 = 2,2 
as T=) nay. 
n=1 


If either S or T are unbounded, there is nothing to prove. So we may assume that 
both S and T are finite. Using the Cauchy-Schwarz inequality, for any a, 6 > 0, 


we find that 
n aa n + 2 —— 
(x (x Vat Bn 3) 


n=1 


1 
2 2 

ta d 
< (a +87) [ aa 


where t = J . Thus, for fixed S and T, the right-hand side can be minimized 


with respect to t. Now Carlson’s inequality follows if we just take t = q. 


SESE 
7.5 Exercises 
The problem is there, you must solve it. — David Hilbert 
1. Let f : (0,1] — R be continuous and lim,_,9+ f(z) = oo. For each n € N, 
define f, (x) = min{ f(a), n} on (0, 1]. Show that the improper integral fe f(a) dx 
converges if and only if limyso ie fr(x) dz exists. 
2. Prove the following statements, which are concerned with the behavior of inte- 
grands at infinity. 
(a) If {° f(x) dx converges and limn+. f(x) dx exists, then limnoo. f(x) = 0. 
(b) If f° f(x) da converges and f(x) is monotone, then limps. xf(x) = 0. 
(c) If f° f(x) dx converges and f(x) is uniformly continuous on [a,oo) , then 
limpsoo f(x) = 0. 
(d) If f° f(a) da converges and f(a) is continuous on [a,00) , then there exists 
a sequence 2p, € [a,oo) such that 
lim t,=o0, lim f(x,) =0. 
n—-oco n+ oo 
(ce) If f-* |f(«)| dx converges and f(x) is continuous on [a, co) , then there exists 
a sequence 2, € [a, oo) such that 


lim ¢,=0oo, lim az,f(a,) = 0. 
noo noo 
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Give an example to show that the conclusion need not hold if absolute con- 
vergence is replaced by conditional convergence. 


Consider the improper integral 
m/2 dx 
T ; = —. . 
(P.4) [ sin? x cos? x 


Determine the range of (p,q) for which the integral diverges, converges condition- 
ally, and converges absolutely, respectively. 


Show that 
i a adx 
9 14+2%sin? x 


converges. This indicates that limsup f(a) = co even if the improper integral 
converges, 


Let p > 0. Prove that 
sing 
gece 
go «? +sin x 
diverges for p < 1/2, converges conditionally for 1/2 < p < 1 and converges 
absolutely for p > 1. 
Let m>1andn>m+2. Evaluate 


os NS aces ae 
og Ihe? 


Let the rational function f(#) = P(x)/Q(a) be integrable on R. If Q(x) has no 
real zero and the partial fraction decomposition is given by 


cg eer ea 


Show that 


° P(x) . 
dx = 2nt Ak, 
i> 
In particular, if x, is a simple zero, then A, = P(x,)/Q' (xx). 
Applying the above result establish 


(a) Let m,n € Nand m <n. Then [~™ or dz = 7 ese (2H41 7) 


—oo l4+x2nr 


(b) Let p,g,n € N and p,q <n. Then 


ie ies ar ee cot ees cot ze 
_o l- x2" on 2n 2n : 


(c) Let m,n € N with m < n and 6 € (—7,7). Then 


c= : 
oo U4" + 2x2" cos6 +1 n sin6 sin (24447) 


i. gee m sin (1 — *2417) 6 


Let x > 1. Show that 


Oe at — 1—2gi-" 
| Teed x” G(n): 
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10. Let a,a, > 0 fork =1,2,...,n anda>°\y_, ax. Show that 


ca sina “ sina,e _7 ie 


11. (Monthly Problem 12260, 2021). Prove 


co + 2 : 
_ 1 

if sin* x — xsinx ae in2. 
0 3 2 


12. Show that ds 
| f(sin? 2) dz = | f(sin? x) dz, 
0 zr 0 


provided the integral on the left hand side converges. 


13. Assume f;~* f(x) dx converges. Prove that there is a € € (1,00) such that 


f(2) 
[a= fre 
14. Let f(x) be nonnegative on R. Furthermore assume the following 


ie, f(x) dx = 1, i uf (x) dx = 0, a a f(x) dx = 1. 


Prove that 
(a) f°, f()dt > ~=s for « > 0, 
(b) f°, f()dt < ee fore <0. 
15. (Monthly Problem 12149, 2020). Let T be the gamma function. Prove 


ew (r (222) < (24) "rere, 


for all positive real numbers x and y. 
16. (Landau’s inequality). Let a,, > 0 for all n € N. Show that 


Co 4 Co Co 
(d2) Some ae Lena 


Show the analogous integral inequality 


([- fayar) so fo f? (a) dx [ @-1yPreae 


does not hold for C = x?, but it holds for C = 4n?. 
17. Let |x| be the integer part of x. Evaluate 


f Neies) 
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18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 
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Evaluate 
1 gine 
———_ dr. 
0 Vv 1- v2 
Evaluate 
| 7 In? x 
————__.—— _ dx 
0 x? — V2x +1 
Evaluate Se 
| aaa Ina dz. 
0 x 
Evaluate i 
if sin 7x InT (a) dz. 
0 
Evaluate 


a x 1\ dz 
0 ev —e-® 2) x?” 


Let {x} be the fraction part of x. Show that 


[gee e=1-1-¥ Fo-0, 


I a and 


where ¥ is the Euler-Mascheroni constant. 
Show that 


mie 35 3 
x In(1 — cos x) dx = —¢(3) — —In2¢(2) — 7G, 
‘ 16 4 


where G is the Catalan constant. 
Show that 


m/A 
| In? (tan x) dx = Zs 
0 


(Monthly Problem 12054, 2018). Prove 


' arctan x 1+2? 1 
In dx = —. 
0 x (1-2)? 16 


(Monthly Problem 12184, 2020). Prove 


[ In(x* — 227 +1) 
1 rVx22—1 


(Monthly Problem 12221, 2020). Prove 


ie In(x® +1) d  In(6) 
0 


dx = rln(2 + V2). 


ee ye Oe 


where G is the Catalan constant )>~_)(—1)"/(2n + 1)?. 
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29. 


30. 


31. 


32. 


33. 


34. 


35. 


36. 


37. 


(Monthly Problem 12228, 2021). Prove 


(In x)? In(2./x/(x? + 1)) 
F =A 


2 


dz = 2G?, 


where G is the Catalan constant )>7~_)(—1)"/(2n + 1). 
(Monthly Problem 12274, 2021). Evaluate 


| ' arctan a in? 2x dys 
9 lt+2? 1— «x? 
Show that 


(a) [7/? 2ln(sina) de = 3 ¢(3) — = n2. (Buler) 
(b) pve a? In(sin x) dx = 3% ¢(3) — a In2. 
Remark. It is interesting to find the closed form of 


n/2 
if x” In(sina) daz, (n EN). 
0 


Show that 


m/2 7 
i, az” In*(cos x) dx = iG (41m? ¢(2) + 81n 2¢(3) + 11¢(4)). 
0 


Show that 


1 
| eo yrs In(1+ 2) dz =In (=). 
0 


eln? x 7 
co p-1}. 
| oe Ne a 


e e °* cos bx — e~%* cos Bx 
0 


x 


For 0 < p < 1, evaluate 


Let a,a > 0. Evaluate 


dx. 


Hint: Differentiate the integral with respect to a and b, respectively. 


Let n,m € N. Evaluate 


(a) Jo. “Tea: 


(b) fo aaeay 
© tea 


Let a,b > 0. Show that 


oo In(1-+a222 ‘ 
(a) iis Gte3 ) da =F In(ab - 1). 
(b) fo~ itasy At = F In(1 +a). 


c° arctan ax-arctan br 2.0 (atb)2F? 
(c) GG at dx = 5 na 
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38. 


39. 


AO. 


Al. 


42. 


43. 


4A. 


45. 


46. 


Improper and Parametric Integration 
Let n € N. Show that 
© In(l +24” ts 2k+1 
i m+ 2) de = ind TY (1+sin (rury) ; 
0 1l+¢2 oe An 


Let n > 1 be positive integer and a > 0. Prove that 


CO 2a" Ine nm? sin(m/2n) 
af dx = 


1+22” 4 cos?(m/2n)° 
(b) limp—+oo i na" nae dy = = 7 Ina. 


Let a, 6,k > 0. Evaluate 
) ye tus ax eke dz. 
) di ae ; sin Be ea ke dz. 


Show that 


jee In(1 — x) In(1 — xy) drdy = 3 — 2¢(3), 
0 Jo 


where ¢ is the Riemann zeta function. 


Show that 
1 pl iIn(1te Y 
: So So CASA, dedy = 5 n2 + $m®2-43¢(3). 
1 pl xv a an 
b) So Jo canta zyzy dady = i In* 2+ gin2-%—-5G. 


c) fo Io ‘ Get, dxdy = ar, (Pi Mu Epsilon Journal Problem 
1376, 2021) 

where G = 7°, (—1)"/(2n + 1)? is the Catalan constant. 

Show that 


m/2 pr/2 (1 —In(1 5 
| | n(1 + cos x) — In(1 + cosy) dxdy = 27G — Tc), 
cos % — cos y : 


where G = 7, (-1)"/(2n + 1)? is the Catalan constant. 
Hint: Note that 


In(1 + cos a) — In(1 + cos y) -[ dt 
cos z — cos y Jo (L4+tcosx)(1+tcosy) 


Let a > 0. Show that 


= P 2 
sin x 35 a 

e “°* dx = arccot(a) + a In P 

| ( r im) (7a) 


For a € (0,1), show that 


Pe ee hates _ mese(t/2a) 
| cos(a*) dx = al (1— a)’ 


Show that 


mI (a+8+1) 
2°+8+1D (a + 1) (8 +1) 


n/2 
‘i cos°t® @ cos(a — B)0d0 = 
0 
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A7. 


48. 


49. 


50. 


51. 


Show that 
0 ace 
se B(1/2,n/2) = 
ae 
n=1 
Evaluate oy 
ih nz d 
0 1 + ex 
Using this result proves that 
~ nal 1 
a (CUTER _ ym2— 5 n?2, 


where ¥ is the Euler-Mascheroni constant. 
Let k € N. Prove that 


[nen —2) de = (ye +1 ¢(2) — ¢(3) —----—¢(K + 1)). 


Let k € N,k > 2. Prove that 


, Lee 
/ nein*(1—2) 4, _( nein (Hea + 2) 5¥€l Ci +1)¢ Kort—9). 


x 


Test your result with 


"Ina ln?(1 — 2) an 2 
| dx = 5$(4). 


x 


ii ne 2) dx = 12¢(5) — 7¢(3). 


ax 


Study the following extension: For m,n € N,n > 2, evaluate 


1 in x In” (1 — 
ns ©) te 
0 


ax 


One possible way is based on Euler integral 


[ (1 -_ tyres! dt = T(p a aC) Te 1) 
0 T(ip+qt1) 


Differentiating with respect to p and q yields 


ly .m ny _ 
/ In™ x In" (1 — 2) dv = D™D™ Be DT(q+ ~| far 
0 © qi(p+q+1) 


In particular, show that 


Hs gE Freer [on -arcine - Yo + Gm +2- 0) 


x 
i=1 
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52. Show that 


1 — 
| In(1 — x) In(1 4+ 2) ae 1 in? 9 
0 lt+2 3 


1 1 
5 m2C(2) + 5 ¢(3). 


Let H,, be the nth harmonic number. Use this result to evaluate 


n+1 


lee) ye asd = n+l p72 
eee gad 5 Se 
n=l a 
Remark. In general, it is interesting to evaluate 


= ' In*(1 +2) In(1 — x) 
1K) = f Ree dx 


in closed form. With Mathematica experiments on & = 1, 2,3, it is expected that 
the final answer should involve the values of Li,(1/2), which is the polylogarithm 
defined by Lin(z) = S77, u*/k”. 

53. (Monthly Problem 11993, 2017). Prove 


[ In(1 — x) In?(1 + 2) d a 3 
Xv —_— ——_ = 
0 x 240 8 


54. Let H, be the nth harmonic number. Show that 


55. Prove 
(a) fh Menem) gp 
(b) : In? & In(1— -) In(l+2) dr = 
1 n?a1n x 
0) Jp sel de = FAC) — 2) 
(d) 


Q 


p mem Sain’) dae = — In? 2¢(2) +} In? 2¢(3) — 3¢(2)¢(8) — 48 ¢(4) + 
6¢(5). 

Hint: Use the identity 6ab? = (a + b)? + (a — b)? — 3a? to reduce the number of 
logarithms with distinct arguments. 


56. Prove 


i" In?(sin x) In?(cos 2) a! 1 
j sin x cos x on 


if InPw+1) | 
0 x 


where ¥ is the Euler-Mascheroni constant. 
58. Let a, > 0 and 7,p,q > 0. Show that 


i gP-1(1—)9-} B(p,q) 
o | 


57. Show that 


ax +B —a) yrs = (arab ray 
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59. For a,2,p > 0, express the following integrals in terms of the beta function. 


i eel a)P1 . i. (1+ 2)?0-1(1 — @)?0-1 


ae 
(x + p)ote = (hedge ere 
Hint: Use the substitutions u = eee and u = rey respectively. 


60. (Ramanujan). For n € N, |z| < 27, show that 


x n ! 
| t” cot(t/2) dt = 2cos(nm/2)n!¢(n+1)—2 So(- 1)ke+)/2__ 
o k=0 


(n— 


z”—*Cl,41(2), 
where Cl,,(x) is the Clausen functions defined by 


. sin(kx  cos(kx 
Clan (x) = ue : Clan+1(2) = ee 
k=1 k=1 


n/2 1 m/2 
i t” cot tdt = — | t”*! ese? t dt. 
0 n+ 1 0 


Then use the above Ramanujan result to evaluate 


61. Show that 


m/2 
I(p,q) =y az? cot*4adx, (p,q €N). 
0 


62. Let 0 < p,q < 1. Show that 


_ oe gP-1 _ 4-1 | tan(pr/2) 
1.4) = f ‘(eee ~  anteayD) 


by using the parametric differentiation and integration, respectively. 
Hint: Notice that ie gt dt = et 


63. Let p be prime and n = p™. Show that 


yO ee 


(k,n)=1 


where ¢(n) is the Euler-phi function, which denotes the number of positive inte- 
gers not exceeding n that are relative prime to n. For example, ¢(9) = 6 since 
that 1,2,4,5,7,8 are relative prime to 9. 


64. Let aj,da9,...,@, € R. Show that 


65. Let n,m € N. Show that 


408 Improper and Parametric Integration 


66. Let p,q € N. Show that 


1 : 4 
y) —q/2,04+PoP-4 4 L+ pj me —p/2,.0-+4+PIapa4 3 x+q) 
(27) q 2 | | r ce = (27) ‘Dp 2 | | | a eee 
j=0 


j=0 3s 
67. Establish the Dirichlet Formula: for a, 8,p,q > 0, 
oo e7 ot ep—1 co e Pt yeq-1 
rT ——— dx =T ——— dz. 
©, Gi *O, Gra ® 


Hint: Using 
T'(q) =| e— B+2)yyI-1 dy. 
0 


68. Let a > 0. Show that 


a a Oo ga? kag 
| dx = | 5 ; dx = ee / en dt. 
0 va? +a? Ja jo w?+a q 


69. Ifa positive function f(x) is twice continuously differentiable on (0,00) and sat- 
isfies 


ay ed) ai), 
(b) f(2x) = == f(a) f(@ + 1/2), 
prove that f(a) =T(2). 


70. The Gauss hypergeometric series is defined by 


ie = a(a+1)---(at+tn—1)6(64+1)---(6+n-1) , 


F(a, B,y,%) = nly(yt+1)--:-(ytn—1) = 


n=1 
Show that 
PO iy Gre) 


F(a, 8,7, 1) = T(y- a) (y- B) 


71. For n € N, show that 


n/2 _ ca 
| sin?” @ ln sin 6 dé = vn De + ae | : du 
° 2 T(n+1) Jo 


mw (2n—1)!! Ld d. 
~ 2° (Qn)! (1 Bo OR in2). 


72. Let a,8 >-—-l1,a+ 6 > —-1. Show that 


fox tiae),, 2, Meena 
0 (l-2)Inz 7 T(a+6+1) 


Extend your method to evaluate 


1 (1 —2°)(1 — 27) 1 (1 —2*)(1—2*)(1— 27) 
| (l—2)Ina au S06 | (l—2)Inz a 
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73. 


74. 


79. 


76. 


77. 


78. 


79. 


Define the digamma function 


I’ (a d 
ve) = Fd = Erte) 
Show that 
(a) Forn EN, 
n—-1 1 
p(e+n)=Vv(2)+ >> mek 
k=0 
(b) For0<2 <1, 
v(e)-Y-2)=- 


For x > 0, show that 


and so 


(a — 1)(a — 2) (a — 1)(a — 2)(a — 3) 
2591 ee) 


Hint: First establish the absolute and uniform convergence of the series on (0, 00). 
Let B,, be the nth Bernoulli polynomial. For z — co, prove that 


[oe) 


w(e) ~ In(w — 1/2) - > 


n=1 


Boy, (1/2) 
2n 


(g — 1/2)-*". 


More precisely, if one truncates the series at N, show that the resulting sum is a 
lower bound for even N and x > 1/2. If N is odd, the sum is an upper bound. 


Prove the duplication formula for the digamma function: 
1 1 
V(2xr) = 5 (He) +H (« + 5)) +In2. 


Prove the following refinement of (7.11): As z > co, 


n\2 1 1 139 
au 14 vince he 
a O) { 38822 5184023 \ 


Let p,q >0,¢<p+1. Define 


mw /2 
I(p,q) = i) x cos?—! x sin(qx) dx 
0 


and pi = (p+ q+1)/2,m = (p—q+1)/2. 
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80. 


81. 


82. 


83. 


84. 


85. 


86. 


Improper and Parametric Integration 


(a) Show that 
(pi) — 0(m) 


I (p,q) = 2°+1T(p, I (qn) [(p)r. 


(b) Show that 


a 2. p-1 —  W((p+1)/2) 
i a” cos? * ada: PrITA(p + 1/2) T(p)r. 


Let f(x) = c(Ina—7(z2)). Show that f is strictly decreasing and convex on (0, 00) 


and i 
lim f(z)=1 and lim f(x) ==. 


x0 ~—-0o0 2 


Let f(z) = x(Inz — y(a)). Show that, for all x, y > 0, 


<fOFW 2, 
f(e@+y) 
Prove that both bounds are the best possible by the stress testing method. 
A function f is called completely monotonic on I if f has derivatives of all orders 
on I and 
(—1)"f™(2)>0 for all « € I and for all n> 0. 
Show that f(a,x) = x°(Inz — (2)) is strictly completely monotonic on (0,00) 
if and only if a < 1. 
Let f(z) =InIT(a)/ax. For « > —1,n EN, show that 


1 
(yf) (a) =(n + 0)! | t+1C(n +2, at +1) dt 
0 


and f’() is completely monotonic. Here ¢(s,a) is the Hurwitz zeta function (see 
Problem 13 in Section 7.4). 


Simpson’s Dissection Formula). Let f(z) = \>°~_, anz”. Show that 
n=0 


oo 1 
: kn+ 
Akn+me& Ee k 


—_ 
n=0 j= 


wr 1 F (ua), 


oO 


2Qri/k 


where w =e is a primitive kth root of unity. 


Use Simpson’s dissection formula to show that, for p,qEN,0O<p<dq, 
[q/2] 


2 
»(2) =-y 5 cots Ing zy cos P™ In (2sin “*). 
qd q qd 


n=1 


A polygonal number is a type of figurate number that is a generalization of 
triangular, square, etc., to an n-gon for n an arbitrary positive integer. Let P(n,r) 
be the nth r-gon number. Show that 


P(n,r) = snl(r 2)n — (r — 4)] 
and for r > 5 find 
2 1 
en) 


in closed form. 
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87. 


88. 


89. 


90. 


91. 


92. 


(The Herglotz trick). Here is an outline of the proof of the Euler’s reflection 
formula due to Herglotz. Let 


N 


g(x) = 


tanmtxz Noo n+a 
n=— 


Verify that 

(a) 9'(@) = — sae + Ce GE 

(b) g/(a) is continuous for 0 < a < 1 if g’(0) = g’(1) = 0. 
) g'(x/2) + g'((@ + 1)/2) = 49'(2). 

) Let M = maxo<z<i |g'(x)|. Then M < M/2 which implies that M = 0. 
e) 9(#/2) — g((@ + 1)/2) = gate —2 Drew Ge 
) 

) 


g(a + 1) = g(2). 
g(x) is a constant. 


hk). {ees .. 


0 1+t n=—-ocoO n+zx 
For x, > 0 and a € (—7/2, 7/2), prove that 


co 
t?—le—A¥ COS & cos(At sin a) dt = A~*T'(z) cos az; 
0 


co 
| tole At cos sin (At sin a) dt = A~*T'(x) sinaz. 
0 
Establish the functional equation 


2r(1—s) J. . cos 2mmrax sin 2mrex 
C(a, 8) = Te Atos {snc d, ae + cos(rs/2) d snare . 


Let ¢(s,a) be the Hurwitz zeta function (see Problem 13 in Section 7.4). Show 
that 


¢(s,a) = — + 


2 a-—1l 


a {=8 lore) 2 2\-a/2 t 
8 8 +2 f (s* + 2°) ; sin(a arctan x/s) ae 
0 ere — 1 


Using this result concludes that 


1 1 sa Asx dx 
ae 
¢(s, 2) ae + S os (s2 + 22)2(e2"@ — 1) 


Let (a) be the digamma function. Show that 


1 a 2t dt 
v(x) =Inzx - i (x2 + ¢2)(e2"* — 1)" 
Hint: Note that «)'(x) = ¢(a, s). 


Prove Binet’s formula: 


InT(2) = (« 5) Ing —«4 : In(27) 4 2 | arctan(t/2) a 
0 


e2nt =] 


A412 Improper and Parametric Integration 


93. (Kummer’s Fourier Expansion for InI(x)). For 0 < x < 1, show that 


i 1 1 1 Ink 
In = —5 nQsinaz) + 5(7 + nQ7)) (1 2x) 4 p 2, 5 sin(27kx). 


94. For a € (0,1), prove that 


i: In In(1/z) et (« 2a) ten) +m = 2), 


1 — 2cos(2am)ax + x? 2sin(2a7 


95. (Monthly Problem 11806, 2015) Prove that 


“8 n 


20 
ih log I (—)e cos * sin(a + sin) dx = (e — 1)(log(27) + y) + 3 
0 


n=2 


96. Refine Carlson’s inequality by replacing the multiplier \/a@ + 8x?, which is used 
in Hardy’s proof, by \/a + Bx? + y+. 

97. (Monthly Problem 11746, 2013). Let f be a continuous function from 
(0,00) to R such that the following integrals converge: S = f>~ f?(x)dz,T = 
fo. 2° f?(x) dx, and U = fy° xt f?(x) dx. Let V = T+ VT? + 38U. Given that 
f is not identical to 0, show that 


( ireiae) <r PAVE 


Remark. This result is an improvement of Carlson’s bound 1?,$T only if SU/T < 
(11+5/5)/2. But, based on the refined Carlson’s inequality above, a better bound 
is given by 17ST — 1?T3/U. 


98. Given f : [1,00o) > (0,co) and a constant c > 0, show that if 


~ dx 


1 f(x) 
If the bound ct? is replaced by ct? Int, does the reciprocal integral still diverge? 
99. (Monthly Problem 11697, 2013). Let n and q be integers, with 2n > q > 1. 


Let 
en tai" + +25") 4 5 
t= 1+: dL. 
fy) ) eee é : 


im 2/2” my ies a : 


100. (Monthly Problem 11793, 2014). Prove that 


log(n +1) . 
S ost + 1) + 41 su — 


n=1 


t 
| f(a)dx <ct? for allt > 1 then 
1 


Prove that 


where ¢’ denotes its derivative. 
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101. (Monthly Problem 11796, 2014). Find 
i sin((2n ak 1)z) eet ym-1 dx 
0 sin x 
in terms of a,m, and n, when a > 0,m > 1, and n is a nonnegative integer. 


102. (Monthly Problem 11802, 2014). Let Hn.» = S°;_,k~°, and let D, = 
n! yp (—1)*/k!. (This is the derangement number of n, that is, the number of 
permutations of {1,2,...,n} without fixed pionts.) Prove that 


Co 


= (-1)” 7 Dn 
Ay, a : 
2d 2 nl 6e dX n(n + 1)? 


103. (Monthly Problem 11842, 2015). Let ~ be the Digamma function, that is, 
w(x) = (InT(2))’. Let ¢ = (1+ V5)/2. Prove that 


or tan(V5r/2). 


3 vnt+¢)-—V(n-1/d) wa? tan 2(/50/2) 
nz+tn—-1 ~ Of B V5 


104. (Monthly Problem 12285, 2021). Prove that, for a > 0, 


mies ve as Eos 
dt = — 5 cost 
¥ [ tetiee= (Zor d ge) a 


105. Prove that there exists a unique function [,T'(2) > 0 for x > 1, such that L(x) = 
InT(a2 +1) in which L(x) has the following properties 
(a) L(0) = 0 (Initial condition, 1! = 1), 
(b) L(a +1) =In(x+ 1) + L(a) (functional equation), 
(c) Lia +n) = L(n)+aIn(n+1)+7r,(x), where limy... T(x) = 0. 
This problem gives another characterization of the gamma function. 
106. Show that 


pe 


1 -1 2 
Inztanh ~ x T 7 
i aan), Og Pg 


107. Prove that 


ii T(a + ee: n (1 = 2-7") Box 1 | ( 1 
Vale) QR —1) RT \ ganna 


where Bo, are Bernoulli numbers. 
108. Let y= 2/(1-—e7*). Evaluate 


I= | e 4? fy dx. 
) 


109. Let Jo(x) be the Bessel function of zero order. For n € N, evaluate 


Re if me J (x) de. 
0 av 
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110. 


111. 


112. 


113. 


114. 


115. 


116. 


Improper and Parametric Integration 


Let e 
f(x) = | (1 — er(t-28¢9)) sec? 6 dd. 
0 


For a > 3, show that 


i ao 3e-2% f2(z) Hieeged a. 


(a) 


Evaluate 


Mate) =nn—1) ff (u—v)? eS dudu 


in terms of the gamma function. This integral is called the moment generating 
function for the mid-range of a random n-sample from the logistic distribution. 


Evaluate 
L, = ia e7* cos ary dxdy 
"doco Jo Vax? 40? (ua + Vx? + 02)" 
Hint: Use 


iis ” 
| e™ cosxy dz = —_,. 
0 yer 


Find all the continuous functions f : [1,co) > R such that 
/ f(t) dt =} (rt tr 2 +... +t) f(t) dt 
x 1 


for every x € [1,00) and every n € N with n > 2. 


Find a continuous function F'(t) for t > 0 satisfying 


m= [ F(ts) — F(t — ts) 4 


1— 2s 


and F(0)=C > 0. 
Prove that 


n n n+1 9Q* 
(a) e=0 el = Sat k=1 oe 

n n+ 2n+1 ke 
(b) dox=o @) = Sie k=0 aoe 

n 1 _ pn+1 (n+1)p—-1 1 14 [((p—1)/2] (—1)* cos(wik/p) 
(c) k=0 ay —— p k=0 a [((n+1)p—k]2*-P G ' pe aur eeieih et) 4 
Hint: Use 


(") = (n+ yf v®(1—2)"-* de. 


Let f : [0,1] > R be integrable. Show that 


ee f(xy) dxdy = — i, f(x) Ine dz. 


Using this result derive 


' ft In(1 + zy) 1» 
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117. Let p and q be nonnegative integers. Evaluate 


i [-? Bo poe es 


2 ey) xy” dxdy = 2 al — 5) : 
— zy 3 


k=1 


Test your result with 

1 pl 

a 

118. (Hadjicostas-Chapman formula). Let s > —2. Prove that 


ae + (_tney)* dedy =I +2) (cle-+2) : Ms 
———(—Inzy)* drdy = T(s 8 —_ —— 
o Jo (1— xy) stl 
119. (J. Sondow). Let y be the Euler-Mascheroni constant. Prove that 

(a) eo pea (4 — In BE) = ° i = Acayyenay) = nea) dxdy. 

(b) n4 =O, (1 2 -™) = 0 aay 


120. Let f(x) be a continuous extension of H,,. Show that 


He). (E-s45) =? ae 


Verify that f(x) = f(a —1)+1/x and 


[ Heyie=y, f° fle)dr=m + inn 


121. (George Stoica). It is well-known that [” e~*/2 dt cannot be integrated in 
finite terms. Let P be a polynomial. Prove that 


i) P(t)e" /? dt 


can be integrated in finite terms if and only if fies P(t)e-@/2 dt = 0. 
Hint: Let H,, be Hermite polynomial which is defined by 


(n) 
H,,(t) = (-1)"e"/? (eo?) & PSO TI. 


Show that 


/ H,,(t)e~* /? dt = —Hy_1(a)e~® /?. 


122. (Gregory summation formula)—an analog of Euler-Maclaurin summation for- 
mula. Show that 


lim 2 fl) 5400) — [ nar} = J+ (-1)8 1G, Ak f(a) 
i=a a k=1 


where G; is the Gregory coefficient defined by 


=1 +50 Gia', for |z| <1. 


In(1 
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123. 


124. 


125. 


Improper and Parametric Integration 


Show that 


Co 


> (# Ink —¥ a) = 30 In(27) +7). 


k=1 


Let pn(x) be the Legendre polynomial on (0, 1): 


Show that there exists integers A, and B, such that 


04 | i — PED ys (e)pn(y) dedy = (An + BaC(3)\dy 


1-2 


where d, = lem(1,2,...,7). 


For A, and B, as in the previous problem, show that 
0 <|An + Br¢(3)|d,3 < 2(v2 — 1)4"¢(3). 


Remark. This result implies that ¢(3) is irrational. 
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AMM 

12148, 2019 E1557, 1963 11604, 2011 12270, 2021 
12220, 2020 12153, 2020 11528, 2010 11786, 2014 
11935, 2016 11771, 2014 11875, 2015 12120, 2019 
E2860, 1980 11376, 2008 11559, 2011 11811, 2014 
11821, 2015 11973, 2002 12129, 2019 11367, 2008 
12210, 2020 11153, 2005 11851, 2015 11852, 2015 
11976, 2017 11995, 2017 12166, 2020 

Putnam 

1970-A4 1966-A3 1953-A6 1966-A6 
2012-B4 2001-B6 2002-A5 2018-B4 
2016-A2 1969-A6 1949-B5 1963-A4 
1950-A3 2008-B2 1947-Al1 2006-B6 
CMJ 965, 2011 1211, 2021 

MM 2136, 2022 2087, 2020 

Chapter 2 

AMM 

12101, 2019 12084, 2019 11829, 2015 11954, 2017 
11400, 2008 11409, 2009 12241, 2021 12287, 2021 
12004, 2017 11649, 2012 11910, 2016 11999, 2017 
11384, 2008 11910, 2016 11930, 2016 11932, 2016 
11952, 2017 11810, 2015 12134, 2019 12194, 2020 
12102, 2019 12206, 2020 12215, 2020 12262, 2021 
11068, 2004 12026, 2018 11809, 2015 11260, 2006 
11982, 2017 11515, 2010 11853, 2015 11333, 2007 
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11299, 2007 
11685, 2013 


Putnam 
2020-A3 
2021-B2 
1948-A3 
2004-B5 


MM 


Chapter 3 


AMM 
11555, 2011 


Putnam 
2021-A2 
2012-A3 
1988-A5 


Chapter 4 


AMM 
11369, 2008 
10739, 1999 


Putnam 
2003-A2 
1986-Al1 


Chapter 5 


AMM 
11819, 2015 
11961, 2017 
12205, 2020 
11457, 2009 
11517, 2010 
11133, 2005 


Putnam 
1968-B4 


12029, 2018 
11438, 2009 


2008-A4 
2002-A6 
1949-B2 
2014-A3 


2097, 2020 


10818, 2000 


1998-B1 
2013-B3 
1990-B5 


10261, 1992 
11892, 2016 


2010-A2 
1999-B4 
2009-B5 


11780, 2014 
12046, 2018 
12318, 2022 
11941, 2016 
11417, 2009 
11981, 2017 


2007-B2 


List of Problems from MAA 


12110, 2019 
11499, 2010 


2016-B1 
2011-A2 
1966-B3 


11872, 2015 


1986-B4 
2021-A6 
1996-A6 


10604, 1997 
6585, 1988 


2002-B3 
2005-B3 


11812, 2015 
11872, 2015 
11152, 2005 
11535, 2016 
11946, 2016 
12193, 2020 


2006-B5 


11739, 2013 
12289, 2021 


2016-B6 
2001-B3 
1994-A1 


1964-B3 
1971-B2 
2014-B6 


11957, 2017 
11641, 2012 


2014-Al 
2010-B5 


12308, 2022 
11933, 2015 
11924, 2016 
11548, 2011 
12229, 2021 


1980-A3 


List of Problems from MAA 


2016-A3 
1991-A5 


Chapter 6 


AMM 
11848, 2015 
11597, 2011 
11299, 2007 
3815, 1937 
11885, 2016 


Putnam 
2014-A1 


Chapter 7 


AMM 

12288, 2021 
11564, 2011 
12149, 2020 
12228, 2021 
11746, 2013 
11802, 2014 


1940-A3 
2014-B2 


11897, 2016 
12207, 2020 
11916, 2016 
11410, 2009 
11973, 2017 


2015-B6 


12281, 2021 
11937, 2016 
12054, 2018 
12274, 2021 
11697, 2013 
11842, 2015 


1968-A1 


11765, 2014 
12242, 2021 
12060, 2018 
11515, 2010 
11982, 2017 


2016-B6 


11709, 2013 
11680, 2012 
12184, 2020 
11993, 2017 
11793, 2014 
12285, 2021 
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1987-B1 


12297, 2022 
12051, 2018 
12026, 2018 
11659, 2012 
11890, 2016 


12317, 2022 
12260, 2021 
12221, 2020 
11806, 2015 
11796, 2014 


Taylor & Francis 
Taylor & Francis Group 
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